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SUMMARY 


The derivation of an approximate error characteristic equation 
describing the transient system error response is given, along with a 
procedure for selecting adaptive gain parameters so as to relate to the 
transient error response. A detailed example of the application and 
implementation of these methods for a space shuttle type vehicle is 
included. An extension of the characteristic equation technique is used 
to provide an estimate of the magnitude of the maximum system error 
and an esti ma te of the time of occurrence of this maximum after a plant 
parameter disturbance . 

Techniques for relaxing certain stability requirements and the 
conditions under which this can be done and still guarantee asymptotic 
stability of the system error are discussed. Such conditions are 
possible because the Lyapunov methods used in the stability derivation 
allow for overconstraining a problem in the process of insuring stability. 

Practical implementation problems such as system noise and in- 
complete state feedback are studied and results given in terms of a 
bounding criteria on the system error. Under these conditions, 
asymptotic stability discussions are inappropriate and instead one 
speaks of bounded stability or stability in the large. 
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I. INTRODUCTION 


During the last twenty-five years the theoretical developments 
making up the classical feedback control theory have been in constant 
use in the design of automatic controllers. In most commerical applica- 
tions in the past, using the classical tools of Nyguist and Bode plots, 
root-locus methods, etc. the designer was able to develop systems 
satisfying a set of somewhat arbitrary performance indices, i.e. rise 
time, peak overshoot, bandwidth, etc. With the advent of the U. S. 
space program, the requirements of guidance and control for space 
vehicles demanded more and varied analytical tools than were offered 
by classical theory, and hence was born what is now referred to as 
modem control theory. 

Virtually all of the theory of both the classical and modem 
control sciences required as a basic assumption that the plant be time- 
invariant or that it vary in a well described manner. Starting with 
the ground-breaking work at MIT in 1959 [1], the study of adaptive 
control systems began. The major reason for interest in such a control 
area was the knowledge that a large number of physical processes were 
inherently time— varying and optimal and classical techniques left 
much to be desired. As a corollary to this, new techniques for system 
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identification were desired. 
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By the mid - 1960’s the groundwork for the study of adaptive 

* . ■ 

control systems was laid. The most promising form of adaptive control 
studies appeared to center around those methods based on Lyapunov's 
Second Method and model-reference adaptive systems (MRAS) [2,3,4], a 
technique which, as part of the design process, can be used to guarantee 
stability of the adapted control system without need for an analytical 
description of the solution to the dynamic system, 

A particularly promising form of adaptive controller that was 
based on the idea of on-line, time-varying feedback gains was published 
in 1968 [5] and then later extended to more general cases [6,7], 

These methods suffered from the need for very slowly time-varying plants, 
although no knowledge of plant parameters was needed. This limitation 
was later partially removed [8]. 

Some of the shortcomings of these MRAS design techniques included 

(a) all states must be available 

(b) no noise present 

(c) rate of convergence of the errors was unknown due to 
the non-linear, time-varying form the closed-loop 
adaptive controller assumed 

Analytical studies of inconq>lete state feedback [9,10] and stochastic 
noise [9] were performed to extend the adaptive controller studies to 
include real-world problems. An approximate solution to the error 
convergence rate is given in [6 ] and generalized to a number of different 
types of MRAS controllers in [11]. At least one study neglected all 
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physical - realizability conditions and used a controller requiring 
complete knowledge of the plant in order to adapt the plant [12] • 

As mentioned earlier, adaptation and identification are similar 
problems, and using the Lyapunov approach to MRAS type controllers it 
is possible to develop identification algorithms which can be used in 
a real-time environment to continuously identify a system without 
need of disturbing the system [13,14]. 

Although research was originally financed through the space 
program, there are a number of areas where adaptive control is presently 
under active investigation. Some of these areas include (1) anti-skid 
braking systems where the human driver represents a time-varying, 
statistically indeterminate plant, (2) chemical processing plants 
where optimum control of temperature, pressure, humidity, and material 
flow is extremely important to insure maximum monetary return, 

(3) a re-entering Space-Shuttle-type vehicle where wide variations in 
atmospheric conditions cause stability difficulties, (4) high per- 
formance aircraft and missiles. Specifically, many of the areas of 
study covered in this report stem from problem areas related to Space- 
Shuttle-type vehicles. Corrupted measurements of position, velocity, 
and acceleration of such a spacecraft, computer and A/D and D/A 
round-off, incomplete state feedback, and saturation are some of the 
real-world problems which allow, at best, only a prediction of stability 
regions . 
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The purpose of this study was to extend the theoretical work on 
model-reference adaptive control systems outlined in the Second 
Technical Report. Specifically, this report is concerned with 
practical considerations that must be accounted for in implementing 
an MRAS controller within the framework of real-world problems. 

These practical considerations include (a) noisy input and state 
measurement, (b) extending stability bounds and still guarantee 
asymptotic stability, (c) need for a design method for selecting 
adaptive gain parameters and relating them to the error dynamic re- 
sponse, (d) stability criterion for the case of incomplete state feed- 
back. Analytical stability results for these cases could then, together, 
reveal something of the overall stability of a plant in a real-world 
environment. 

There are four chapters subdividing the material into major areas 
of investigation to the body of this report, in Chapter II is derived an 
approximate solution to the non-linear time-varying, adaptive error 
differential equation. This results in a general equation relating 
the error response to the values of adaptive gain parameters. Using 
an extension of this idea an approximate method for estimating maximum 
error magnitude is derived. In Chapter III is outlined procedures for 
extending the conditions for asymptotic stability of a MRAS controller. 
This is an important consideration as one of the drawbacks of Lyapunov 
designed controllers is that sufficient but not necessary conditions 
are obtained and this may result in an adversely limited stability 
criterion. Chapter IV outlines the theory for the case of stochastic 
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systems and incomplete state feedback. Results are available only for 
very restrictive cases as would be expected. An e x a m ple is included 
to illustrate the procedures discussed. Chapter V discusses a few of 
the practical considerations in physical realizability of adaptive 
control laws for a Shut tie- type vehicle. Included are results of a 
control phase-over routine from RCJ to MRAS during atmospheric 
re-entry. A number of simulation results are included for various 
practical controller implementations. In addition, a discussion of 
computer computational requirements is included, resulting in a series 
of graphs relating computer time to various system parameters. 



II. DERIVATION OF A DESIGN IMPLEMENTATION TECHNIQUE 


Most proposed mo del- reference schemes employ Lyapunov's direct 
method in the design procedure so as to guarantee sufficient conditions 
for asymptotic tracking of the model by the plant [15]. A number of 
model- reference schemes have been proposed in the literature [3,5,6, 
7,16] which work rather well in practice. In all cases, however, no 
general technique has been put forward for selecting the constants in 
the adaptive gain equations so as to cause the plant to track the 
model with a p re- determined error dynamic response. In the past the 
choice of these constants has been a trial and error procedure at best 
because of the inherent non-linear nature of the adaptation dynamics, 
even when the plant is linear. Because of these non-linearities an 
exact closed-form solution of the error dynamics as a function of the 
desired constants has not been possible and an Intuitive "feel" for 
the relation between choice of the constants and the resulting 
response is difficult to obtain. Consequently, simulation studies 
have invariably been necessary to obtain an acceptable set of adaptive 
gain constants. In this chaoter a straightforward method for choosing 
these constants is given. 

The major result of the derivation which follows is a general 
error characteristic equation which relates the error dynamic response 
to the adaptive gain coefficients. Through an extension of this 
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approach a means of estimating the maximum error and the time after a 
perturbation from = 0 that this maximum error occurs is given. 

The results show the error magnitude at time t^ to be a function of 
the plant parameter disturbances at time t^ < t 2 « 

A number of simulation examples are given throughout the chapter 
to illustrate the implementation of the techniques. An exaaq>le of 
the pitch axis of a space shuttle vehicle is given to show the 
implementation of the adaptive gain parameter design method. A second 
example is included to illustrate the magnitude estimation procedure. 

A. Problem Formulation 

The basic equations defining the MRAS controller are considered 
in this section. The basic plant and model state variable formulations 
are 


^p(t) = Ap(t)Xp (t) + B p (t)u(t) (II-l.A) 

V t} = Vm (t) + B "£ (t) (II-2.A) 

where 

Xp(t) - n x 1 plant state vector 

x (t) - n x 1 model state vector 

“m 

u(t) - r x 1 input vector 
A ffi ,Ap(t) - n x n matrices 


B m *Bp(t) - n x r matrices 
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It is assumed that the elements of Ap(t), B^Ct) include unknown, 
slowly time-varying or time-invariant parameters. Adaptive gains 
K. i j a (t) and K^^(t) are to be implemented in the plant controller in 
order to force the plant states to follow the model states. These 
gains are defined as 


U^Ct)] = [c^Ct) + K.. a (t)], 

(II-3.A) 

[b .. P (t)J = [c b (t) + K b (t)], 
ij ij ij 

(II-4.A) 


and serve much the same purpose as the fixed optimal control gains 
obtained using calculus of variations. The major difference in concept 
is that the adaptive gains must be calculated on-line since the 
system dynamics are not completely known in advance. The gains are 
computed so as to cause the response error 

e(t) = x^Ct) - ^(t) CII-5.A) 

to tend toward zero. The basic plant-model dynamics with adaptation 
are shown in Figure l.A. 

Using (II-5.A), the error state equation is derived as follows: 

e(t) - xjt) - Xp(t) 

e(t) = [A^Ct) + - [Ap(t)Xp (t) + B p (t)u(t)] (II-6.A) 

Adding and subtracting AjjJC,(t) allows (II-6.A) to be written in the form 
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e(t) = A^Ct) + 1% - ApCtJJXpO:) + [B^ - B p (t)]u(t) 

e(t) = A^e/t) + A(t)Xp(t) + B(t)u(t) (II-7.A) 


where 

A(t;) = A m - A p (t), (II-8.A) 

0(t) - B m - B p (t). (II-9.A) 

The basic purpose in using a Lyapunov function in the design procedure 
of a model-reference adaptive control system is to guarantee that the 
system error is asymptotically stable. By constructing a Lyapunov 
function positive definite in e y such that V evaluated along the state 
trajectory is negative definite in e, the system error will asynptotically 
approach zero thus assuring that the plant is tracking the model. A 
number of appropriate Lyapunov functions have been proposed in the lit- 
erature [ 2, 3, 4,5 ,6 J. The Lyapunov functions in [3,5,6,16] are special 
cases of the one in [7] which is used here and is given in (II-10.A), 


n 


V " Oft. ^ a ^ a ij ^ij £ e k , 5ki x pj + 
i,j-l “ij k-1 


& 


I •***1 + 1 J ,. 


n r 

+ l l JL 

i-l j=l Yij 


n 

{b ij + 6 ij l e k9ki u j 
k-1 


+ a 


ij 


dt 


n 


£ ®k q ki u j 
k=l J 


} 2 + 


n 


I l °ij I I e k9ki u j 

i=l j=l L k*=l 


1 2 


(II-10.A) 
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In the above equation, Q is a symmetric positive definite matrix, 
and b^j are elements of the A and B matrices, and y^j are constants 
greater than zero, and gjj , p.^ , <5 ± j , and are constants greater 
than or equal to zero. 

Taking the time derivative of V in (II-10.A) and evaluating along 
the error trajectory given in (II-7.A) results in a sign indefinite 
V. If the a^j and b^j terms are chosen to be of the form 

n n -i 

*ij " ’ a ij e k<Iki*pj " *ij ~ e k<Jki*pjJ 

“ p ij [ Ji e k q k iX pJ . i.J - (II-ll.A) 

b ij " “Yij Vki U j ‘ 6 ijd?[Ji 



e k<lki u j 




i«"l,2,...,n and j»l,2»...,r 

(11-12. A) 


then the resulting V expression reduces to 


V - e (AmQ + “2 £ f J ^^ki^jl 

i,j=l k-1 J 

-2 ? I «ij f" l e k q ki ujl . (II-13.A) 

i-1 j-1 L k=l J 


The complete derivation is given in [7]. The last two terms in 
(11-13. A) are at least negative semi-definite since the and are 
constants greater than or equal to zero. It is well known [1] that if 
the A matrix is stable, there exists a symmetric positive definite 
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T 

matrix Q which satisfies the equation ^ Q + QA ffi = -C, where C is a 

symmetric positive definite matrix. Therefore, if is stable, the 

first term in (11-13. A) is negative definite in e_ thereby making V negative 

definite in e^. With V positive definite in _e and V negative definite 

in je, the error £ = - Xp is guaranteed to be asymptotically stable. 

d b 

The adaptive gain rates, are determined from (II-3.A) , 

(II-4.A), (II-8.A), and (II-9.A) as follows 
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T 

The q^ are elements of Q and must satisfy the relation Q + QA m 
Adaptation is implemented by means of these equations so as to cause the 
plant to track the model. 

In order to implement the adaptive controller, some criteria for 
selecting the a, 8, p, Y> 5, a adaptive gain parameters other than by 
trial and error simulation is needed. In addition, some means of 
determining the Iq^jJ elements is desired, inasmuch as the requirements 
that 

(1) Q be positive definite 

(2) Ajjj^Q + QA^ = negative definite matrix 

will offer, in an indirect way, only bounds for the values of the 
individual elements of Q. The following section addresses this problem. 

B. Development of the Linearized Error Equation 

In this section, a technique for obtaining an approximate solution 
to the adaptive error dynamic state equation is given. This method is 
based on a linearization of the error dynamics about a set of plant 
operating conditions at the instant that a perturbation in plant 
parameters occur. The linearization is necessary because, although 
the plant and model described by (II-l.A), (II-2.A) are linear, the 
resulting adaptive controller is non-linear. This comes about from 
the gains given in (11-18. A) and (11-19. A). To show this expand 
(11-18. A) for the particular case i = 2, j = 1, 
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K 21 (t) = a 21 f s dt + e 21 [s] 

c o 

+ P-, d_ [S] (II-l.B) 

dt 


where 

s = (e 1 q 2i + e 2 q22> x lp< t > 


Substituting = x 1m - x lp and e 2 = x 2m - x 2p into (II-l.B) yields 

2 

S = [x lm x lp (t) ' x lpC e > ^21 + [Xi p (t)x 2m " x lp (t)x 2p (t)]q 22 


Similar results can be obtained for the general case for both K^\.(t) 

and K^j(t). It is clear that the gains involve both squares and cross 

products of the plant states, resulting in a non-linear feedback law. 

Because of the large amount of work involved, the technique is 

first presented for a second order system with a scaler input. The 
th 

results for an n order system with r-inputs are presented at the end 
of the section. 

Consider a second order plant with the linear, time- invariant 
transfer function 


V 3 ) 

u(s) 




(II-2.B) 


The plant equations in phase variable form are 
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( c 2 1 + K 21 ^ ^ c 22 + K 22 ^ x 2 . 


(II-3.B) 




The model is described in phase variable form by 


Substituting (II-3«B) and (II-4.B) into (II-7.A) yields the error 
differential equation 


m m . m _ m a T a 

a 21 a 21 " C 21 ~ k 2l’ a 22 a 22 “ C 22 ~ k 22 


. . b . b 

b 2 = b m ' C 2 ~ k 2‘ 


represent the plant parameter errors. 

The equations for the three adaptive parameter rates may be 
obtained from (11-11. A) , (11-12, A), (11-16. A) and (11-17. A) 


K 2i = a 2i (Y) + 3 21 — 00 + P 21 (Y) » 1 = 1>2 > 

dt dt 2 


(II-6.B) 



where 


2 

Y ■ , Z 

k-1 


and 


where 


k!J = y 2 (Z) + <$ 2 d_ (Z) + a 2 _ (Z), 

dt 2 

dt 

2 

z- l 

k=l 


\ q k2 u * 


(II-7.B) 


Assume that a constant input U° has been applied for a long time 
and that the plant is tracking the model. The system parameters in 
this equilibrium state are given by = x£, U = U°, e = e_ - 0, 

K 21 = K 21» K 22 = K 22’ 311,1 K 2 = K 2 °* We sha11 derive the characteristic 
equation for the error e^(t) assuming that a small disturbance occurs 
in any or all of the adaptive parameters, thereby causing a resulting 
disturbance in the plant states. Expanding (II-5.B), (II-6.B), and 
(II-7.B) in a Taylor's series about the equilibrium point and truncating 
all second and higher order terms yields 


Ae^ *> Ae 2 

* a ao a ao o . a 6 a o b 

Ae 2 “ < c 2l + K 2 i)Aei+ (c 22 + K 22 ) Ae 2 - x lm AK 21 - x 2m AK 22 - U AK 2 

♦ t) * o o 

AK 2i - (®2i < 5l2 x ip + B 2 i«I12*ip + p 2i q 12*ip> Ae l (II-8.B) 

O "p 

+ (a 2i q 22 x ip + 6 2i q 22 x? p + P 2i q 22 x ip )Ae 2 

+ (®2i q 12 x ip + 2p 2i q 12 x ip^ Ae l + ^2i q 22 x ip +2p 2i q 22 x lp^ Ae 


+ P 2i q 12 x ip Ae 1 + P 2 iq 22 x ip Ae 2 , i-1,2 

AK 2 - Y 2 q 12 u ° Ae 1 + Y 2 q 22 U° Ae 2 + <s 2 q 12 U<) A ®1 + 6 2 q 22^ A ®2 

+ o 2 q 12 U 0 A ei + o 2 q 22 U°Ae 2 . (II-9.B) 
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Taking the Laplace transform of (II-8.B) and (II-9.B) using the 
relationships = x£ m = x^ * x° m = x^ = 0 and AE 2 (s) = sAE^s) and 

3. St 

substituting the resulting expressions for AK 21 (s), AK “ 2 (s) , and 
b 

AK^s) into (II- 8 .B) yields 

S ' 

{sIs 2 -sCc| 2 +Kf2) “ Ccfi + KfJ)J + > 

♦ 6(& 21 x^ + t> 2 V° 2 ) + e Cp 21 ^n + ° 2 0 ® 2 ^ < ll2 + 

8 I( a 21 x t£ + y 2 U * ,2) + 8 ^l^m + 6 2^ 2) 

+ s2 <*21*l£ + a 2^ 2) ^22 } AE 1 (8) " -C^Kg+UP^). 

(II-10.B) 


In CII-10. B) let 


K 1 = a 21^ + Y 2 U° 2 » K, = B 21 x^ + 6 2 U° 2 , 


and 


K 3 = P 21^ + °2 U ° 2 * 


(II-ll.B) 


The characteristic equation for the error e(t) can be obtained 
by setting the coefficient of AE^s) in (II-10.B) equal to zero and 
dividing by the first term in order to place in the standard form for 
plotting root loci (i.e., 1 + KG(s) - 0). 


q 22 Kl(s+q 12 /q 22 )(l + s + K 3 / s 2 ) 


s[s 2 -(c| 2 + KfJ)s -(c^ + Kf|)] 


(11-12. B) 
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This is of the form 


1 + K(s + a) (1 + bs + cs^) 


= 0 


s[s^ - (eg + Kg). - (eg + K*°) ] 


(11/13. B) 


where K = q^K^, a = q 12^ q 22’ b = K 2^ K 1* ^ C = K 3 ^ K i* The compensator 
thus looks like a proportional plus integral plus derivative (P-I-D) 

controller with an added zero at s = -a = _< li2^ q 22* * n t * ie adaptive 
scheme proposed by Gilbart, Monopoli and Price [6], is zero since 
f>2i aad a 2 do not appear in the adaptive rate equations. Their equa- 
tions. Their compensator, therefore, is a proportional plus integral 
controller with an added zero at s = -a. In the adaptive control 
scheme proposed by Winsor and Roy [5], K 2 and are zero since |3 , 

<S 2 , f>2\ ^d °2 not a PP ear t ^ ie adaptive rate equations. Their 
compensator behaves as an integral controller with an added zero at 
s = -a. 

The above procedure is easily extended to include the general 
case of an order plant with r inputs. In general there will be 
nr transfer functions between the r inputs and n outputs. The transfer 

♦■Vi 

function between the i c input and the j output is of the form 


Gij(s) - 


biJ s 1 - 1 * /- 2 + . 


, ij ij 

+ + b£ 


s n + + a2s n- ^ + . . . + a^^ s + 

and for i ■ 1,2 r ; j - 1,2, ..., n. 


, for Z< n, 
(11-14. B) 


If the system can be put in the form 
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x = Ax + B where 


'0 1 

0 0 ... 0 


b ll b 12 

... b lr “ 

0 0 

• • 

* • 

• 4 

1 0 ... 0 
» * * 

t • t 

* • 4 

A 

B = 

b 21 b 22 

4 

• 

m 

... b 2r 

-a -a . 

n n-1 

« * * 


L b nl b n2 

b nr_ 


(11-15. B) 

then the results of (11-12. B) can be extended to the case of multivari- 
able systems. The general conditions under which such a transformation 
can be made are discussed in Appendix B. Using equations (II-2.B) 
through (11-12. B) for the cases of n = 1,2, and r = 1,2, ***, by 

mathematical induction a general expression for the linearized adaptive 
error characteristic equation was developed. The general form for 
this equation then becomes 


1 + 



<Jkn s 




sA (s) 

ID 


o. 


(11-16. B) 


where p is the type of controller defined by 


and 


! 1, Winsor and Roy, 8 = p = 6 = cr = 0 
2, Gilbart, Monopoli, and Price, p = c = 0 
3, Boland and Sutherlin 


K 1 °nl x lm + ^11 + y 21 + + Y nl^ U l 


’J* (Yj_2 ^22 * * * 
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<Ylr + ^2r + ‘ * >+ Y nr> U r (11-17. B) 

K 2 = ®nl x lm + ^11 + 5 21 + ••• + 5 nl) U r 

+ (6 12 + S 22 + . . . + 6 n2 )uf 

+ ... + (6 lr + 6 2r + ... + « nr )uJ 2 (11-18. B) 

n 2 q2 

k 3 55 + ^ a H + °21 + + a nl) u l 

+ (^^2 * ^22 + • • • + a n 2^2^ 

+ ... + (a lr + a 2r + ... + a r )uJ 2 . (11-19. B) 


Note that for n = 2 , (11-16. B) reduces to 

1 + (922 + q 2 2 s)(K l + K 2 s + K 3 s2) (ii . 

sA m ( s ) 

which agrees with (11-12 *B) if one assumes that the plant and model 
dynamics are identical before the small perturbation occurred. 


C. Decoupling the Input From The Linearized Error Dynamics 

The general expression for the linearized adaptive error equation 
in the form of the characteristic equation of a single loop negative 
feedback system 1 + GH(s) = 0. The locus of the error roots as a 
multiplicative parameter gain in GH(s) is varied can be sketched using 
the well known root-locus techniques. These error loci begin at the 
zeroes of 


sA m (s) - 0 


(II-l.C) 
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representing the model poles ^(s) and a zero at the origin due to 
the integration in the adaptive gain expressions, and end at the zeroes 
of the polynomials 

t l V 1 ' 1 ]! I (II-2.C) 

i=l k=l 

The zeroes of the second factor depend on the values of the elements 
of the Q matrix which are chosen to satisfy 

AjQ + Q\ = -C (II-3.C) 


in order to guarantee asymptotic stability. The zeroes of the first 
factor depend on the relative values of K-p and ^ 3 * all greater 

than zero, as given in (11-17. B), (11-18. B), and (11-19. B) „ Factoring 
out of this polynomial results in 


<= 2 + 


bs + c) , where b 


< 2 / 


*3 


K- 


1/Kc 


The roots of (II-4.C) are 



(II-4.C) 


(II-5.C) 


The dependence of these roots on the various input magnitudes as well 
as x x o i s evident in (11-17. B), (11-18. B), and (11-19. B). Unless 
this dependence is eliminated, the ending points of the root loci, 
determined by the zeroes of (11-16. B), will be a function of the inputs 
and x-jjjj. This would mean the entire character of the root loci would 
change as the inputs and changed. 
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Consider the second order system error characteristic equation 


q 22 K 3 (s + q 12 /q 2 2^ s2 + K 2^3 S + 

1 4* - ■ * 1,1 — 0 

sA m (s) 


where Kj_, K 2 , and K 3 are as given in (II-ll.B). In (II-6.C) the gain 
ratios are given by 


O 2 . r ttO^ 


$ 71 x,„ + <$,U' 
K 2 /K 3 = - 21 ^ 2 


o2 

p 21*lm + , 2 U 


and 


a 21*lm + y 2 


'+ y^u° 


Ki/K 3 = 2 2 

p 21*lS' + ° 2 °° 


(II-7.C) 


If the adaptive gain parameters are chosen such that 


Y 2 / a 21 = ^2^21 = ct 2^ p 21 = d = constant 


then (II-7.C) reduces to 

3 21 (x lm 


k 2 /k 3 = 


( x i™ + d U° ) 6 


21 _ 


P21< x lm‘ + d LT ° > P21 


and 


K /k - d u ° 2) - “21 

1 3 ~ ”17^77^ ' ~ 


= c 


21' lm 


21 


(II-8.C) 


(II-9.C) 


(II-10.C) 


2 

In this manner, the zeroes of (s + K 2 /K 3 s + K^/K 3 ) are made independent 
of the magnitudes of the input U° and x^° and the shape of the root locus 
became a function of the a-priori fixed a, 6, p, y, 6, o adaptive gain 
parameters, with the actual root location on the loci being a function 



22 


only of the gain factor q 22 K^. Comparing (II-8.C) with (11-18. A) and 
(11-19. A) indicates that this choice simply places a weighted emphasis on 
the three terms in the and K^j adaptive gain expressions. This is 
a logical choice since it would not be uncommon to place more emphasis 
on the adaptation of certain parameters than on others. This is done 
through the proper choice of the constant d. The constants b and c in 
(II-9.C) and (II-10.C) establish the weighted importance of the pro- 
portional and derivative terms to the integral term in the adaptive 
gain expressions. These ratios are the same for all adaptive gains. 

The above results for the second order case with scalar input can 
be extended to the nth order case with r inputs. By doing so, (11-17- 
18-19 .B) result. In order to insure that the ratios K^/K^* K 2 /Kg, 

K^/K 2 are independent of variations in input magnitude and state values, 
if the expressions 


(Y 11 + T 21 + -" Y nl ) 


(Y U + Y 22 +...Y n2 ) 


(y. + V- +...Y ) 

lr 2r nr 


are related to ot^ and similarly with the 6's and B's in K 2 and o's and 
p's of in (11-17-18-19 .B), then if the adaptive gain constants are 
chosen to satisfy the following relationships, decoupling of zero place- 
ment from input magnitudes results: 
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YH+ Y 21 +..-+ Y nl 


6 11 + 5 21 + * * ,+ 6 nl 


a ll + a 21 + " * + a nl 


V 12 + Y 22 ~ K, * + Y n2 


*12 + 6 22 + “‘ + 6 n2 


°12 + °22 + * * ,+ a n2 


v, + Y„ + . . .+ Y 

'lr 1 2r nr 


6 n + 6„ +...+ 6 a + a +...+ a 

lr 2r nr * lr 2r nr = C 


(II-ll.C) 


where C^, are positive constants. Substituting (II-ll.C) into 

(11-17. B) , (11-18. B), and (11-19. B) one obtains 

K 1 - + C 1 U ? 2 + C 2 U 2° 2 + "- + C r"f> 


K 2 - + Vf + C 2 “S 2+ -"+ C r U f) 

K 3 ‘ + + h V ( C r U ? 2 >‘ 


(11-12. C) 


Using (11-12. D) 


V K 3 = ^nl^nl = b ^ K l /K 3 = a nl /p nl = c 


(11-13. C) 


2 

and the roots of (s + bs 4* c) are independent of U°, U^* . 


Such a "decoupling" scheme would have practical implications in 
terms of the control of aerospace vehicles* wherein, a well defined error 
response would be highly desirable over a wide range of inputs* Such 
conditions could occur in a space shuttle vehicle in regards to varying 
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RCJ thrust levels and varying roll-pitch-yow commands (given by elevon 
motions) required to stabilize the vehicle. The following is an example 
which shows pole-zero movement with and without the decoupling procedure 
being used. 


Example 


2nd order, 2 inputs 


Gm^(s) — Gn^ (s) — ■ — ^ 


s 4-2s+2 


(11-14. C) 


V s> • 


G P 2<S) 


s +2s+a 


21 


s + 2 s+-a 2 ^ 


(11-15. C) 


o^, 02 , adapting 

With two inputs and p = 3, (11-16. B) becomes 


1 + 


K 3 q 22 <Stq l2 / ' , 22 ) (s +K 2 /K 3 !H ' K i /K 3 > - 0 


(11-16. C) 


s(s +2sf2) 

Selecting as suitable parameters 

a 21 “ 40 ^21 =40 P 21 = 10 q 12 = 2 q 22 ~ 

? 2 2 
(s + K 2 /K 3 s + K x /K 3 ) - s + 4s + 4 = (s + 2) 


K l = 

k 2 = 

K 0 = 


40 X lS + Y 21 U 1 + Y 22 u 2 

2 2 0 2 

40 xj® + 6 2 1 U 1 + «22 U 2 

n 2 0 2 o 2 

10 + a 21 U 1 + *22 U 2 


(11-17. C) 
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DECOUPLED CASE 


In order to "decouple" the error dynamics of and ct 2 as compared 
with a 2 £ in (11-15. C), it is necessary to employ (11-11. C) 

Y 21 6 21 °21 


a 21 $21 P 21 


= Ci = 1.0 


Y 22 _ 5 22 _ a 22 _ 0 n 

2 ,0 


(II-18a.C) 

(II-18b.C) 


Using (II-18a,b.C) , the K ± in (11-17. C) became 

K 1 = 40 ( x lm 2 + - 1 -* 0 U ? 2 + 2,0 U 2 2 ^ 

2 2 2 

K 2 = 40 (x x ° + 1.0 U° + 2.0 Dj ) 

2 2 Q 2 

K 3 = 10 (x x ° + 1.0 Uj + 2.0 U 2 ) 

and (11-16. C) reduces to 

2 

10( X]L o 2 +1.0 U° 2 +2.0 U 2 )(s+2)(s 2 +4sf4) = 0 (11-19. C) 

1 + 2 

s(s +2s+2) 


For the particular cases of 


(a) Uj = 3, U° = 0, x x £ = 3/2 

! + <,«r n 3 , 0 

s(s 2 +2s+2) 


(11-19. C) becomes 

(II-20a.C) 


Cb) ® 3, ^2 - 6, - 9/2 (11-19. C) becomes 

(1012.5) (s+2) 3 


s ( s 2 +2s+2) 


(II-20b.C) 
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The root loci and location of the closed loop poles for (II-20a,b.C) 
are shown in Figure II-la.C. Note that the "shape" of the root locus 
is input magnitude invariant, although the root locations are a function 
of the input magnitude. 

COUPLED CASE 

Now consider the same example without using (II-ll.C). Such a 
case would be 


t 21 

4' Ki = 1 

s n, K - 
»21 2 

2 

°21 

P 21 

* 

II 

0^ 

~~ “ K = 4 
01 4 

21 * 

6 22 

6 = K 5 = 

°21 

5 

a 22 = 
P 21 

V 6 


Using these numbers in (11-17. C) results in the zeroes of (11-16. C) being 
2 2 2 

a function of , U° , U^ • For the same conditions as the "decoupled" 
case 


. o o o 

(a) U = 3, U = 0, x = 3/2 
1 / lm 


(11-16. C) becomes 


(29.25) (s+2) (s +2. 778s+l. 538) 

1 + = 0 

s(s +2s+2) 


. (263.25) (s+2) (s +3. 32s+2. 64) 

(b) 1 + z = 0 

s (s +2s+2) 


Figures ll-lb.C and H-lc.C show the root loci and position of the 
closed loop error roots for (II-21a,b.C) . Note that as the inputs change, 
the entire shape and character of the root loci changes. From the stand- 
point of well-behaved error dynamics, this is a highly undesirable 
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situation. Hence, in order to obtain a good design, with well defined 
error dynamics, the decoupling scheme in (1X—11.C) should be used, it 
requires no additional computational difficulties and the degree of 
control that results is well worth it. 

D. Application of the Error Equation 

The design of an adaptive controller using the class of model- 
reference schemes discussed consists of determining the best combination 
of values for the adaptive gain parameters ot, 8, p, y, 6, o and the q^ 
elements. At best this is a trial and error process unless some system- 
atic technique is utilized. The basic error equation in (11-16. B) will 
now be used to develop a design method based on the location of root 
loci as the adaptive gain parameters are adjusted. The location of the 
roots of the linearized error characteristic equation in the s-plane 
will, to a first order approximation, completely characterize the nature 
of the transient response of the system error. By going to a linear 
system description of the error, the familiar figures of merit from 
classical controls such as rate of convergence, settling time, per cent 
overshoot, etc. can be used. 

That the design method is based on the small-signal approach is of 
no concern, because completely independent of the design technique the 
plant has been guaranteed to be asymptotically stable using Lyapunov 
theory. In this way, if an error perturbation occurs, even if it is 
very large, the adaptive system will force the error towards zero, and 
the closer the error gets to zero the better the small signal approximation. 
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By designing for a very fast transient response the error will be forced 
to be near zero. This is a noticeable departure from the usual analysis 
of systems by small-signal approxmations . At no time is (11-16. B) 
Implemented as part of a control system. It represents only an analyt- 
ical tool to aid in design of an efficient, practical MBAS controller. 


Example : Application of the Error Equation to & Space Shuttle Vehicle 

This example clarifies the design method applied to the pitch-axis 
attitude control system of a space shuttle vehicle using aerodynamic 
control surfaces during re-entry. Because of the extreme variations in 
altitude and velocity encountered, the plant dynamics are time varying 
with order of magnitude changes of as much as 200 occurring. 

The basic vehicle configuration is shown in Figure (Il-l.D). It is 
assumed that the pitch axis is decoupled from the roll and yaw axes. 

The linear time-varying plant dynamics are obtained as follows: 


M . -I 0 = f (a, 6, 6 ) 
pitch pitch in e 


(II-l.D) 


where 


I 


a = angle of attack (radians) 

0 ~ pitch rate (radian | sec) 

= elevator deflection (radians) 
pitch = raoment inertia of the pitch axis of vehicle 


Expanding f in a Taylor series about a , 0 and 6 yields 
xn . o o 


f m (a, 0, <$ e ) = f m (n 0 , 0 O , 6 ee ) + ( a -a 0 ) + ^>(0-0 o ) + 


3f 


m 


( < 5 0 -| 5 0 ) + higher order terms (HOT) 
e e 


(II-2.D) 







31 


By selection of appropriate axes. 


£ . { ,-„u0' v 'f a + f m i9 + f„ S e 

pitch — m a hiq ro^ e 


(II-3.D) 


where f^, f m » , f^ represent moment stability derivatives. Through 
some involved calculations, these moment derivatives can be related to 

the well known aircraft stability derivates C™ , C^. , C_ as follows 

0 o_ 


& 

P 

II 

ccv2Sr ef /2I p • C„ a - 

C l C "a 

f • = 
m e 

AVr,«V % ' 

c 2 C me 

f = 

X 

cp v ' s re£ m P • ■ 

rn 

II 


(II-4.D) 


where 

p = air density (time varying due to altitude changes) 

S_ = vehicle reference cross sectional effective lift area 
e f 

c = vehicle characteristic length (used to normalize stability 
derivatives) 

V r = vehicle relative velocity 

= aerodynamic stability partial derivative taken with respect to x. 
x 

Because p and V r vary with time in an indeterminate manner (dependent 
upon re-entry trajectory which is controlled "on-line" by the pilot) the 
vehicle dynamics are time-varying. 

Defining 

x^ = 0 X£ = 0 = a = <5 g 

the unadapted vehicle dynamics can be written as 
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• 

X = 

'0 

1 

X + 

"0 0 

£ 

0 

c,c 
2 "ej 

£ 

C l C m C l C “u, 

u i U2 


(XI— 5 . D) 


Plots of typical mission profile data for p and V r are showa in Figure 
(II-2.D). Using nominal values for Cj^, C^, C,,^ , the actual time 
varying plant coefficients are shown in Figure (II-3.D). With the 
dynamics of the form Xp = ApXp + B^U it is clear that the zero in the 
a££ position implies a pure integration; hence the unadapted vehicle is 
unstable. The basic attitude controller with the adaptive gains included 
is shown in Figure (II-4.D). The equations of the plant with adaptation 
are 


V [° 

♦ [° 

[ (c iS + 


K 2 f(t) (C 2 c„ s + Kf 2 ( e ) ) J 


K 21 (t)) <C,C„ + ^ (t>) 


“uz 


22 


U (II-6.D) 


where K^Ct) and K^Ct) are the adaptive gains. 

A model based on the two assumptions that (1) no complex roots are 
desired and (2) a fast, over damped response is desired, was chosen to be 


I <S> - £ <s> - 

U 1 u 2 + 3s + 2 


-.05 


(s+1) (s+2) 


(II-7.D) 


For the plant chosen, specific parameter values used were = 1.047 
(a=60*), U 2 = 1.13438(6e=65°) , and x£ m = -• 0545(attitude= -.0545 radians). 
The general adaptive gain parameter equations are 
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where 


K,f=a21 
Z1 o 


W dt + 321^ + ^21^t K 22'“22 -C 0 

6 22 Y+ 

K 2 Kl t* z dt + d 21 Z + °2IJt K 2 r Y 22 ■£* 
S 22 S+ °223t IsI 

W ‘ e l q 12 X lp + * 2 q 22 *lp’ Y ' e l q 12 x 2 p +e 2 q 22 * 2 p md 
Z " e l q 12 U l +e 2 q 22 U l • S ' e l q 12 U 2 +e 2 'l 22 u 2 


Y dt + 

(II- 8 .D) 
S dt + 


(II-9.D) 


and the a, g, p, y» <5 » a, q 12 , q 22 values are yet to be determined. 

In order to choose appropriate values for the adaptive gains a, 
g , p, Y» 6 , and a the root loci for the three model reference adaptive 
control schemes in references [3, 5, 6 ] are plotted in Figure (II-5.D), 
The loci begin in all three cases at the zeroes of the model character- 
istic equation plus an additional locus beginning at the origin. The 
loci end at the zeroes of (1 + q^/q^Kl + K 2 / K l s + ^ 3 /% s ). In all 
three cases the zero at ^12^22 was chosen to be “ 3 with q^^l.26 and 
q22=0.42« It is desired to locate this zero as far in the left half 
plane as possible. However, this ratio is limited to three in this 
example in order for the Q matrix to be positive definite. 

Using the above values the characteristic equation for the Winsor 
and Roy method is 

1 + o t where k = „ (II- 10 .D) 

s (s + 3s + 2) 

The root loci for 0 _< k _< 00 are shown in Figure (II-5.D(a)) 

The Gilbart, Monopoli, and Price method has an additional zero at 
s ~ * s c ^ ear that this zero should be as far to the right 

as possible in order to pull the root loci to the left. This zero should 
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not be to the right of s = -3, however, since for high gains the root on 
the real axis is the dominant root and determines the speed of response. 
The additional zero is placed at s * 4.5 and the error characteristic 
equation becomes 

1 + - - S — — S + * 0, where k = q 22 K 2 (II-ll.D) 

s(s Z + 3s + 2) 

The resulting root loci are shown in Figure (II-5.D(b)). 

The additional zero in the Boland and Sutherlin method is placed 
at s = -4.5 which yields an error characteristic equation of 

1 + ^ = 0, where k = qooK-i (11-12. D) 

s (s 2 + 3s + 2) Ll J 

The resulting root loci are shown in Figure (II-5.D(c)). 

In order to verify the results of the linearization procedure the 
time response of the error for each of the three model-reference schemes 
was computed. A gain of k = 10 was used in each case. The location of 
the roots of the linearization error equation for this value of gain 
are shown on the root loci in Figure (II-5.D). 

In each of the three methods the conditions of (II-ll.C) are 
satisfied with = C 2 = 10. Using these values of and C 2 , the gain 
k = 10, and combination of zero locations given in (II-10.D), (II-ll.D), 
and (11-12. D) , the adaptive gain constants can be computed and are given 


in Table 1. 



(a) Winsor and Roy 
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netnua xii 

Reference 

a 21 

a 22 

g 21 

e 22 

p 21 

p 22 

y 21 

y 22 

S 21 

5 22; 

°21 

°22 

15] 

100 

100 

0 

0 

0 

0 

100 

100 , 

0 

o: 
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0 

■ J3J 

450 

450 

100 

100 

0 

0 

45 

45 

10 

io: 

0 

0 

m 

2025 

2025 

900 

900 

100 

100 

202.5 

202.3 90 1 

90; 

10 

10 


Table II-l, Adaptive Gain Values 

The time response of the error e-^Ct) for the Winsor and Roy method is 
shown in Figure (II-6.D(a)), where the model and plant states are identi- 
cal at time t Q = 150 seconds. At t+ a step disturbance is given to all 
of the adaptable parameters in (II-6.D). The disturbances are such 
that at t = the plant transfer functions are 


Q Cs) = .073 and 6(s) = - .073 

U x (s) (s+0) (s4- . 009) * U 2 (s) (s+0) (s+.009) 


(11-13. D) 


The model transfer functions are as given in (II-7.D). The response in 
Figure (II-6.D(a)) is highly oscillatory as predicted by the root locations 
in Figure (II-5.D(a)). The dotted line in Figure (II-6.D(a)) is the 
unstable error response for the system with no adaptation. 

The time responses of e^(t) for the Gilbart, Monopoli, and Price 
method and for the Boland and Sutherlin method are shown in Figure 
(II-6.D(b)). These two responses plot as one curve since the real root 
is the dominant one at this value of gain k. Again the time response 
agrees with the response as predicted from the root locations in the 
s-plane. In all three of the adaptive control methods the error approached 
zero asymptotically although the plant parameters are time varying. 


Unadapted 



Figure II-6.D.Time Response of the System Error Due to a Plant Disturbance 
at t = 150 seconds (a) Winsor and Roy 


System error’ 10 



Time From Booster Separation (seconds) t start = 150 


(b) 


Figure II-6.D. Time Response of the System Error Due to a Plant Disturbance 
at t = 150 seconds (b) Gilbart, Monopoli, and Price; 

Boland and Sutherlin. 
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E. Adaptive Error Determination 

As an extension of (11-16. B), representing an approximate char- 
acteristic equation of the adaptive error, a technique for approximating 
the magnitude of the maximum error and the time interval from application 
of a disturbance until maximum error is reached is presented. Advantages 
of the proposed error estimation scheme include: 

(1) prediction of the maximum error and its time of occurrence 

(2) saturation non-linearities can be avoided, or at least 
designed around 

(3) simple solution of the error dynamics is available 

(4) insight into the relationship between adjustable adaptive 
gain coefficient selection and the error magnitudes is avail- 
able. A simulation example is given demonstrating the 
utility of the proposed method. 

Referring to the basic second order derivation of the error 
equation, it can be seen that (II-10.B) is in the form 

AE^s) <l+GH(s)) =- Xjq K 2 f° + U°K 2 b ° (II-l.E) 

where (1) l+GH(s)- represents the error characteristic equation (2) 

K 21°’ K 2°~ re P resent steady state adaptive gain values at the instant 
a perturbation occurs. Following along the lines of the previous error 
derivation, (II-10.B) can be generalized to 
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1 (S) j S V S) + p =1 

+ if » 3 v°] 


where 


x ,° - E s B .(o)u ' 

m j=l J J 


Ul 

represents a sum of m terms not necessarily in consecutive order 


Rearranging (II-3.E) and using the fast that 


Ae(t) = e(t) - e(o) = e(t) - o = e ( t ) 


AE x (s) = E^s) - 


i. c. 

sA m <s)+£ K s (i 1J £ q. £ 
_i=l 1 j=l Jn 


where 


Kf , c. represents an "initial condition" gain 


i.c. ° - K nl° X lS + EE U jM° 


The denominator of (II-5.E) represents the error roots which determine 
the error convergence rate; i.e. 

S V S > + ^vHfe q jn s<j X) = L (s+ Pk> 88 0 (H-7-E) 
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where 

= closed loop error roots 
y = n - 2 + p 



Figure II-l.E. Typical Error Versus Time Trajectory 


Shown in Figure (II-l.E) is a typical error versus time trajectory 
for an adaptive system with real dominant roots. Dividing the numerator 
and denominator of (II-5.E) by the factor sA m (s) , E(s) can be modeled as 

E(s) = K . (II-8.E) 

1 + G(s) H(s) 


where G(s) = 


s A m (s) 


represent the open loop poles of the error dynamics 


and 




which is shown in Figure (II-2.E) as a single-loop feedback control 
system with no input and output E(s), With no forcing function present 
the error response is due solely to the initial conditions. That this 
is so should have been expected since the MRAS error is asymptotically 
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f(-) is a non-linear operator wich 
transforms x-^ and U° into initial 
conditions for the error equation 


Figure II-2.E Error Magnitude Simulation Model 
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stable and therefore must tend to zero independent of any forcing function. 
Consequently, the only "driving function" on E(s) is the initial condition 
gain c> 

Because the MRAS scheme is not an identification technique, best 
results for magnitude prediction are obtained only if either (1) all the 
adaptive terms are numerator coefficients of (II-14.B) or (2) all adapting 
terms are denominator coefficients. The actual adaptation process works 
equally well with all terms adapting; it is simply that no unique values 
for and the K.b° are then available. This is because the adaptive 

ni ij 

controller identifies output state values (the error goes to zero) but 
does not necessarily identify plant parameters. This^ means 


G m (A) 


G (s) 
P 


2 

s+2 


a 

5+e 


a, 3 adapting 


then any — - 2 might result, depending on initial conditions* 
S 

fixed, then 3 would correctly identify the plant parameter* 

It should be noted that the numerical magnitude of 

v l 


If a is 


ao 


K.cJ - *nl *l“ + 22 U i h 

ij 


bo 

ij 


(II-9.E) 


in no way effects the small perturbation linearization analysis. The 
o 

magnitude of Xi depends only on the input and model and the K. . only on 
m ij J 

the cumulative total plant parameter misalignments. The linearization 
analysis presumes only that small changes K. 1 ? occur at any given instant. 
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Using partial fraction expansion and (II-6.E), the inverse trans- 
form of (II-5.E) becomes 

e(t) = Aje^ + A 2 e P2t +. . .+A y e p y t y yi(n+l) . (II-10.E) 


The time at which maximum error occurs can be found by taking the time 
derivative of e(t) and solving for the t at which e(t) = 0. 

In most work of practical and significant interest* e max could be 
taken to be 

max t , ) 

e max = h ^^h^f (II-ll.E) 


where there are h solutions obtained from e(t)=o. Two of the most 
likely types of responses would be (1) a pure exponential decay or (2) 
a damped sinusoid. Either one of these responses would result in 
e(t)=o, implying a relative maximum or minimum of e(t). 

Under the assumption that E(s) can be approximated by a second- 
order plant with real poles 




(s+p^) (s+p 2 ) 


(11-12. E) 


where 


P = 


n-1 

£ P k if n=l 
i 

1 if n=l 


e (t) = K 
P 


i^c, Kwi 

(p 2 -p 1 ) l e J 


Pl<P2 


(11-13. E) 
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To obtain an estimate of e max , set 

de(t) = 0 
dt 

or 

-p i e” P l t + p 2 e' p 2 t = 0 (11-14. E) 

from which the time interval t m , representing the elapsed time from 
occurrence of a perturbation to the occurrance of maximum error can be 
found. 


t = In (p /p ) 15. E) 

m 1 2 

Pl' p 2 

Substituting (11-15. E) into (11-13. E) results in a simple expression 
for estimating the maximum magnitude of the error, 

I" ln(p 1 p 2 ) In 


e max 


K i.c. “Pi “73 p 2 

P(p2 - Pi^ e 12 - e 


Pi P2 


(IX-16.E) 


An unusual happening with (11-16. E) is that |K^ c | , the initial 
condition gain given in (II-9.E), is a function of the magnitudes of 
the plant parameter disturbances occurring at the previous disturbance 
time. If at time t adaptation starts and at time t^>t Q error steady 
state has been reached and a set of plant parameter perturbations 
occur, and by time t 2 >t 1 error steady state has occurred again 
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then 


|e<T) max = f(|e (T ) ^ 


Te ( t o ,t l] 


(11-17. E) 




Following along similar lines, an estimate of the error bounds for 
the case of a pair of complex poles and a dominant real root can be 
developed* The error can now be related to the dominant root locations 
as 



K 


x* c 



(s+a+jw d ) (s+a-jw d ) (s+p) 


v 


> 


(11-18. E) 


where s = - 0 (±ja>, -p represent dominant roots of E(s). Using (11-18. E), 
it can be shown that 



(11-19. E) 


K i.c./p -pt 

£- e 

(a-p) 2 +w d 


Proceeding as in (11-14. E), 

de(t) » at jacos oJ d t-90°-tan ^ ^ 


sin(ojjt-90 -tan 


‘fe>] - 


C 2 pe 


-pt 


= 0 


(11-20. E) 
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where 


K. /T> 

i. c* /P 


~ C = 

1 2<D d 2 ^l+/kr2.\2 (a-p) 2 +w d 2 


K i.c./P 


l u d 


(11-20. E) is of the form 


cos (u d t+0) + a 2 sin (w^t+0) + a-je ^ = o (11-21. E) 


which is a transcendental equation in t, the variable to be solved for. 
Since a^, a 2 » and a^ are known constants, (11-21. E) may be graphically 
solved for those points, t^, which satisfy the equation. Substituting 
the t d into (11-19. E) and determining 


e 

max 


max 



(11-22. E) 


yields a "best estimate" of the maximum value of the error. 

Unfortunately, due to the uncertainty in the plant parameter 
perturbations, the "direction" of the error time trajectory above or 
below zero when a disturbance occurs cannot be predicted beforehand. 
To demonstrate this, consider the following n order linear plant 


u (s) = 


(II-23a.E) 


s n +a^ 1 s n- l-+a* > s n 2 +. . .+a?s+a£ 
n-1 n-2 l o 


and the a 1 "* 1 order model 


Xm 1 

— (s) - r— 5 rr 

U s I1 +a^ -1 s n - 1 +a“_ 2 s n Z +. . .+a®s+a® 


(I 1-2 3b .E) 
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As before it is assumed that at steady state 

e k (t) = 0 , a k m = a^ p k= 1, 2, ... n (11-24. E) 

The sign of e^ depends on the "direction" of plant perturbation, i.e. 
if a disturbance occurs at t = t Q 

e (t + ) < 0 if a p (t + ) < a m (11-25. E) 

O O o o 

e(t D + ) > 0 if a Q P (t 0 + ) > 

Since the sign of depends on future conditions, nothing can be said 

about sign definiteness. Since the error is defined as e^ = Xjj, - x p > 

then if e t (t) < 0, k * 1, 2, ...n the plant state x. (t) lags the model 

*P 

state, and if e. (t) > 0, the reverse is true. 

P 

The error magnitude estimation procedure can be of particular 
value in the case of linear plants with a saturation non-linearity 
of the type shown in Figure II-3.E. With a priori knowledge of the 
expected range of values of U, a "worst case" design can be anticipated 
and the appropriate adaptive gain parameters adjusted so as to allow 
x^ P to remain within the linear range of operation. Knowing a priori 
a range of values of IJ and the plant parameter variation, an estimate 
of K^ 30 and K^j^o can be performed; these values coupled with (II-9.E), 
(11-16. E) , and (11-19. E) allow estimates of maximum e-^ by maximizing 

iH.c.l- 

Assuming the plant output saturation value is C s , the maximum 
allowable error, e a , is determined to be 




= C„ - x, (max) 
s J-m 


( 11 - 26 . E) 


where x, (max) is strictly a function of the input(s) , since the model 

ui 

has been fixed a-priori. If \ei\ > |e a |, then the model and/or adaptive 
gain parameters must be modified and |ei| recomputed if plant saturation 
is to be avoided. 


EXAMPLE: 


Consider the MRAS system with model 



where a is an unknown and (possibly) slowly time-varying plant para- 
meter. For the case of U = 4y(t), the steady state output of the 
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plant becomes 


*1 ( s, s, ) = 


L m 


= lim h. 
s-K) s 


2 

TT^r 


2S + 2 


= 4 • G(0) = 4 


Using the development in [7], the root locus equation from (11-16. B) 
becomes 


where 


1 + K 1 + k 2 s qi2 + Q22 s 
s s2 + 2s + 2 

o 2 

K 1 = “21 x l ra 
o 2 

K 2 “ 6 21 x l m 


and it is desired to determine q 12> q 22 , q 21 , b 21 such that the error 
roots are real. An acceptable compensation scheme is 


1 + k 2^22 (s + 2) 2 

s(s2 + 2s + 2) 


(11-27. E) 


which is in the familiar form 


1 + k P(s) = 0 
o 2 

with K = q 2 2 (®2l x l m > 

A plot of (11-27. E) is shown in Figure (II-4.E). From an investi- 
gation of this figure, a desireable set of error roots exists if k is 
chosen to be 800. From this information a compatable set of parameters 
is 

a 2l “ 10 $21 = 5 q 12 "" 20 q 22 = 10 
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The closed loop error roots for k = 800 are marked in Figure II-4.E and 
are found to be 


s r = -2.075 s 2 = -1.935 s 3 = -798 


Using the approximation in (11-12. E) 


|e(t) 


l K 2i a ° x i m °l (-00879) 


-1. 9325t -2.075t 

e -e 


L (11-28. E) 

Initial conditions were placed on in order to force “ 2 at 

-l P 

t = 0, At t - o . a step disturbance was applied to Figure II-5.E 

compares normalized values (with respect to the predicted error response) 

aO 

of e(t) versus time for various initial conditions on K^. Note the 
excellent correllation between predicted and actual results. 


F* Design Implementation 


Assuming the plant-model dynamics are expressible in the form of 
(11-15. B), the first step in the design procedure is the selection of 
appropriate, linear, time-invariant models. To date, little design 
criteria, insofar as relating to MRAS controllers is available. Hence, 
a-priori knowledge of physical conditions and overall performance 
criteria must be used to select the models. At present, this is an 
art more than a science. 

Secondly, using A m (s) from G(s) , determine the error characteristic 
equation as given in (11-16. B). It is recommended that (II-ll.C) be 
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employed also to "decouple" numerator and denominator dynamics of 

G^j(s). With these equations values for n of the values, plus the 

a, 3, p, Y> a adaptive gain coefficients can be determined so as to 

obtain a desired transient response. Since this portion of the design 

involves linear frequency methods , the well-known tools of linear 

systems analysis can be utilized to define a "best" response. Since 

Q is a positive definite symmetric matrix there are n(n + 1) distinct 

terms. However, the aforementioned design method only supplies numbers 

for n of the entries; hence n(n - 1) terms are left unknown. It is 

2 “ — 

necessary to insure that for the n elements of Q selected that the 

n(n - 1) remaining elements form a compatable set such that 

2 

(1) Q is positive definite 

(2) A^ Q + QA^ = -C when C is any positive definite matrix 

If A is a stable matrix, a positive definite Q exists which satisfies 
m 

(2) [1], Unfortunately, this method does not take into consideration 
the transient error response. The inverse statement, given a Q a p.d. 

C exists, is not necessarily true. Consequently, selection of the 
remaining n(n - 1) Q elements is an iterative procedure; all that is 
necessary is to show that there exists elements satisfying (1) and (2). 

It should be pointed out that until now, one of the shortcomings 
of using Lyapunov designed controllers was that no clear-cut technique 
existed for relating the Q elements and the a, B, p, Y, 6, cj terms 
Consequently, a common procedure was to select the Q matrix by using 
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an a-priori fixed C (usually the identity matrix I n ) and solving for 
the q^j terms; the adaptive gain coefficients were then chosen by trial 
and error methods. As with the error equation linearization, there is 
no unique set of q^j obtained from (2). 

Although the linearized error equation in (11-16. B) is valid only 
for small errors, the design method outlined can also be used in the 
case of large errors. Since the adaptive error is guaranteed to be 
globally asymptatically stable from Lyapunov theory, no matter what 
the order of magnitude of the errors they will eventually tend to zero. 
Once the errors become "small" the linearized error approximation is 
valid. Estimates of transient performance of the system error for 
large disturbances may not be valid, although simulation results for 
a large number of cases tend to show strong correllation between pre- 
dicted response and large error disturbances. 

G. Error Transient Response Determination With Lyapunov Functions 

Under certain conditions, knowing the form of a Lyapunov function 
V and its time derivative V, it is possible to determine the transient 
behavior of the MRAS error dynamics. However, to be useful, it is 
generally necessary that V be obtained as a function of time without 

having to integrate the system equations. This requirement, plus the 

» 

need for the resulting V and V expressions to be simple have generally 
not made it possible for the following method to be practical. 
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Noting that 



(II-G.l) 


if it can be established that the quantity V is never greater in 

v! 

magnitude than some constant -k, k > 0, then 


V < 


-kV 


(II-G.2) 


and by integration 

-k(t-t ) 

V(Xp,t) _< V(x p> t Q ) (II-G.3) 

If it is known that 

Vi-a(MxpM) 

and V<b(Mipl!) (II-G.4) 

then k is simply 

k = a(tl 2 P l!) 

^ b(Mxpll) (II-G.5) 

Such a k value yields a lower bound on the speed of response. Known 
results in this direction, however, are rare [17,18]. 

As an application of this technique, consider the Winsor and Roy 


Lyapunov function [5], 
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V = 


n n 2 n n 2 

E £ + £ E 

i=l j=l a ij i=l j=l s ij 


T 

+ e/Qe. 


By appropropriate choice of the adaptive gains, 
V = e T (A m T Q + QAjj) e 


(II-G.6) 


from which 


V 


- C 


n 


|Q|le+ EEf 

- i=l j=l a ij 


n 


n 


a ij 2 + 


EEf 

i=l j=l b ij 


b u 2 


V 

(II-G.7) 


where 


-c - a_ t q + QA,. 


If information on upper and lower bounds of the excursions of the model 
and plant parameters is known a priori, then bounds on the last two 
terms in the denominator of (II-G.6) can be obtained. In general, such 
information will not be available, in which care approximations are 
needed. An estimate of the transient behavior of the error using [5] 
will now be performed in order to illustrate the difficulty of using 
the procedure. 


(II-G.7) is in the form 
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where 


or 


A, B, C > o 


(II-G.8) 


A + B + C 


3 £ i + I + I 

A + B + C A B C 


1 <_ 1/3 + 1/3 + 1/3 

A + B+ C A B C 


(II-G.9) 


Using (II-G. 9) on (II-G.7) 


| e jj^= 1, C defined in (II-3.C)) 


V < 




-1/3 

W 1 ) 

* 


-1/3 


le| lc 


n n 


I I 

i*l j=l a ij 


ij 


-1/3 


l kl l 


C 


n n 2 

1 1 JL b ij 

i=l Bij 


(II-G. 10) 


Defining 


k.^ = max 


llellc 


n n 

i i 


1 2 

i=l j=l aij 


/ 


(II-G. 11) 
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l<2 = max 


n 


E EJ_t 

i=i j=i e i j 


ij 


The difficulty with using (II-G.10) is that k^ and V .2 of (II-G.ll) 
require a knowledge of the error £, and unknown quantity. As an estimate 
of the error decay rate, it might be possible to disregard the parameter 
misalignments a^ , bjj and only be concerned with (CQ - *). However, 

results would be only approximate and would need to be interpreted with 
care. Under certain conditions. 


then 


V < 


1/3 ^min 


(CQ-1) 


(II-G.12) 


In the cases of [6] and [7], no results thus far are available 

using the Lyapunov function decay rate approach. This is because in 

both methods, the ratios V are complicated functions of the error and 

V 

thus far no reasonable approximations have been found to simplify the 
resulting ratios as was done In (II-G.6) to (1I-G.12). 



III. DETERMINATION OF STABILITY CRITERIA 
PROVIDED BY LYAPUNOV THEORY 


The adaptive gains given in Chapter II were derived using Lyapunov 
theory. Using this method sufficient conditions for asymptotic stability 
of the error were obtained. Unfortunately, one of the shortcomings 
of the Lyapunov design approach is that sufficient but not necessary 
conditions result, making it possible to "overdesign" a system. Dis- 
cussed in this chapter are various techniques for simple determination 
of elements of the Q matrix such that asymptotic stability is assured. 
Also a method is proposed to relax the Lyapunov sufficiency conditions 
on the Q matrix and still have an asymptotically stable adaptive system 
error. 

A. Conventional Technique for Selection of the Q matrix 

In conventional Lyapunov-designed MRAS control theory, it is 
necessary for the designer to select, a priori, a p.d. Q matrix such 
that A m Q + QA^ is n.d. In practice determination of such a Q matrix 
is difficult. In Chapter II, methods for relating the adaptive error 
response to the selection of the Q elements were presented, however it 
was still necessary to insure independently that A m ^Q + QA ffl was indeed 
n.d. It has been shown [15] that if C is a p.d. matrix, for a given 
A^ matrix there exists a p.d. Q matrix such that 

AjQ + QA m = -C (HI-1. A) 
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However, as will be discussed later in this chapter, the converse is 
not necessarily true. 

By selecting a C matrix at random it is possible to obtain a Q 
matrix satisfying the Lyapunov stability conditions for MRAS controllers. 
In most published reports this is the technique used. However, as has 
been clearly demonstrated in Chapter II, selection of certain elements 
of the Q matrix is desired first. Other sections of this chapter will 
investigate the problem of finding acceptable bounds on the elements 
of the Q matrix such that easy use of the design processes discussed 
is insured. 


B. An Extended Stability Bounding Criteria 

In Chapter II, the particular V function used for deriving the 
adaptive gains is given by (II-10.A) and the resulting V function by 
(11-13. A), repeated here for easy reference: 


V = ^(aJq + QV* 


-2 


E 


i=i 


E ^ij 

j«i 


E e k^ki x pi 

k=l J 


-2 


n r 


E E 

i=i j-i 



e k4ki u j 


2 


(III-l.B) 


T 

Since it is required that A m Q + QA^ be negative definite, and 6 ^ ^ , B > 0, 

» 

then it can be seen that V is n.d. This V is the most general one and 
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is applicable to the case of the Boland and Sutherlin as well as the 

Gilbart, Monopoli, and Price methods. By combining terms and (^) 

of V it is possible, under certain conditions, to relax the requirement 
T 

that Q + QA ffl is n.d. By relaxing this requirement it is possible 
to obtain a wider choice of q^ values. In terms of the linearized 
error equation design method, this means that a larger "stability region" 
for compensating zero placement is possible and still insure asymptotic 
stability of the system error. 

There are five major restrictions involved in the following 
procedure 


1. A is in phase variable form 

m 

2. At least one non-zero input is present 

3. There is at least one time-varying numerator gain term, ie 


G m (s) = - — P or — - — * a time varying 

A m< s ) or unknown 

4. The Gilbart, Monopoli, and Price/or Boland and Sutherlin 
type adaptive controller is used 

5. B m contains all zero entries except for the nth row 


Under these conditions, term of (III-l.B) may be written as 


6nl (e l q ln + e 2 q 2n + * * * + Vnn )ui i 


©= 2 j 

f6 n2^ e l<Jln + e 2^2n + ••• + ^nn^] + ••• 

f6 nr[^eiqi n + e 2 q2n + ••• + e nW u r] | 


(III-2.B) 
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which reduces to 

= 2 |$nl u l + 6 n2 u 2 + ••• + 6 nr u rj |n q ln + e 2<J2n 

l 2 

+ . . . + e n q nn 

The squared factor in (III-3.B.) may be expanded as follows: 

( e l<Hn + e 2 < l2n + • • • + e n q nn ) (e L q ln + e 2 q2 n + • • • + 
2 2 

e l <Iln + 2e l e 2 c lln c l2n + 2 n e 3<Un<!3n + ••• 

2 2 

+ 2 ei e n q ln q nn + e 2 q 2n + 2e 2 e 3 q 2n q 3n + 2e 2 e 4 q 2n q 4n 
+ . . . + 2e 2 e n q 2n q nn + ... + ... + e/q^ 2 
which may be put in matrix form as L 



2 





q ln 

q ln q 2n 

q ln q 3n “* 

q ln q 

T 


2 



=e^ 

q 2n q ln 

m 

^2n 

« 

q 2n q 3n “* 
• 

q 2n q : 

• 


« 

• 

* 

• 

w 

• 

* 

2 


q nn q ln 

q nn q 2n 

q nn q 3n 

q 

H nn 


2 

2 

2 


n = 

2(6 ni Ui 

+ 6 n2 U 2 + 

. . . <$ nr u r ) 



(III-3.B) 


e n^nn^ - 


(III-4.B) 


Defining 
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and 

a = 

(III -3.B) may be written in the compact form 
T “ A T 

fle (a a ) e_ 

Using (III-5.B), (III-l.B) may be rewritten 
V = e T (A m T Q + QA m )e - fle_ T ( 3 , £ T )e 
n n f n 

-2 E E E 

i-i j=i U” 1 J 



q ln 

q 2 n 


which finally simplifies to 

n n 

V = e_ (W)e^ “2^2^ 


i=l j=l 



(III-5.B) 


(III- 6 .B) 


where 

A A 

W = aJq + QV 0 a £ x 

is a n.d. matrix. Under the constraint of the five conditions mentioned 
earlier, (III- 6 .B) may be used as a criterion for insuring asymptotic 
stability of the adaptation error. Using (III - 6 .B) , the condition 

a/q + QA n " -c 
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is relaxed and replaced with the overall condition 

A^Q + QAjn - sH~ “C (III-7.B) 

Using (III-7.B) allows a wider choice of values. When compared 

with the design procedure in Chapter II, (III-7.B) allows the choice 

of values to more closely match with values allowed by linear 

systems ( i.e. root locus) theory. The reason that the allowable 

regions for the zeroes of (11-16. B) may not be as wide as those allowed 

by linear methods is as has been mentioned previously, namely that 

sufficient but not necessary conditions are obtained from Lyapunov 

T 

theory. By using the fixed criteria that A^ Q + QA^ = -C, C p.d., the 
capability of using other information from the Lyapunov V function is 
ignored. (III-6.B) allows for a varying stability criterion which 
accounts for additional stability information when inputs are present. 
This amounts to a coupling effect between the choice of the Q elements 
and knowledge of the range of values of Inputs present. Instead of 
fixing the zeroes of (11-16. B) using p = 1 and then adding additional 
zero compensators due to the type (p = 2, 3) of system, a whole new 
set of zeroes all together may be determined. 

Some of the benefits of employing this extended stability criterion 
include 


(1) allows a wider choice of response characteristic 
of the adaptive error 

(2) the calculations involved are straightfoward and 
involve merely an extension of previously stated 
Lyapunov design techniques 
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(3) asymptotic stability of the error is guaranteed 

The shortcoming of this method is that knowledge of the range of values 
of those inputs which pass through adapted feedfoward gains (i.e. inputs 
corresponding to terms of B in x = Ax + BU which are adapted. However, 
in many practical cases, such a range is available. 

Example 

G m (s) - 2 

s2+2s+2 

Gp(s) = a l 

s^+2s+2 

^^min = 10 

Using (11-16. B) with p = 1 (in order to obtain the stability limits), 
the error characteristic equation becomes 

1+ — £Xs+a) — =Q (III-9.B) 

s(s 2 +2s+2) 

where 


; A ra (s) = s 2 +2s+2 


(III-8.B) 


a = q 12 / 

q 22 

O 2 o 2 

K = q 2 2^ 0t 21 x l in + y 21 U 1 * 


With the center of gravity of the loci of the roots of (II-9.B) at the 
origin in the s-plane, the zero compensator denoted by ’’a' 1 can not be 
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any further to the left of the origin on the real axis than two 
(this will be shown to be true by two independent methods in the next 
section). Since (from a knowledge of linear systems) it is desired 
to have the real root as for out in the L.H. s-plane as possible, a = 2 
is chosen. Using p = 2 (the Gilbart, Monopoli, and Price method) as the 
control scheme, a second zero at s = -4 is selected. This results in 
the root locus expression 

K 2 q22( s+2 ) ( s+ 4) 

1 + . 0 (III-10.B) 

s(s^+2s+2) 


where 


k 2 - (6 21 x 1 ° 2 + e 2l u» 2 ) 


e *12/q22 2 


K l/K 2 " « • 


Using the stability extension scheme, it is only necessary for 

a Am m 

(III-7.B) to be negative definite. Expanding £ -A^Q -( ^\n ~ p '^* 

. . 2 ro m 

function, for the second order case, A m (s) = s - a 22 s - a 2 ^ s, 



which can be rewritten as 
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A 

B 


B 


> 


C J 


0 


where 


A - 2<5 12 uJ q 12 - 2q 12 a 21 m 

2 m 
B = 26 12 Uj q 22 - a 2i m ^22 " a 22 q 12 “ q ll 


C 25 12 UO q 22 - 2q l2 - 2q 22 q 22 m 


(III-12.B) 


If 


(1) A > 0 

(2) AC - B 1 2 > 0 


then V will be negative definite. In order to use (111-12. B), select 


a desired (q 1? / ) ratio (preferably larger than that allowed by the 

q 22 

T 

Q + ■ -C requirement). Select q ^ so as to set the root locus 

gain (= ^2^22^ anc * then fixes q ; then determine if there exists 

a ^11 > ® value such that (2) above is met. If such a q exists, then 


the 


q 10/ ratio may be used. If none can be found, a smaller ratio 
1 ^ / a _ ^ 


4 22 


of q 19 / should be chosen and the procedure repeated. 
/q 22 

Selecting q^ 2 - 4, q ?l> = 1 


22 


(1) is met 

(2) AC - B 2 = 156 - (50 - q..) 2 > 0 
if q u > 37.52 
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Interpretation of results for higher order systems is more complex 
than for a second order case, but the basic procedure is the same. 

C. An Exact Stability Bounding Technique Employing An Algebraic Equation 

As has been emphasized previously, one of the shortcomings of 
Lyapunov-designed controllers is the "overdesign 11 capability. This 
comes from the sufficiency conditions of the Lyapunov theorems. Using 
(III-l.A), where it is desired that C and Q be p.d. n x n matrixes, a 
technique will now be given for obtaining numerical bounds on the elements 
of the Q matrix. This is important because, for any other than a second- 
order system, the relationship between the elements is very difficult 
to determine analytically because of the complex relationships relating 
negative and positive definiteness. As an example, consider the case 
of n - 3, 
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To be positive definite, the conditions on Q are 


q H q 22 q 12 > ° 

q il^ q 22 q 33 _q 23 ^ ~ q i2^ q i2 q 33 


-q q ) + q (q q 
4 23 13 13 12 23 


■q q 

22 13 


) > 0 


Simultaneously, the expression < A m T Q + Q A m ) must be n,d *» requiring an 
equally complex group of relationships. Fortunately, from a Lemma due 
to Kalman [15], if C is p.d. then there exists a p.d. Q matrix if 
is a stable matrix. To obtain all combinations of Q, C would have to be 
ranged through all possible values. 

That the converse to Kalman's Lemma is not necessarily true, and 
the reason for the algebraic method to be given, is easily seen by a 
counterexample. Using 


0 



-2 


1 

-3 



2 

4 


and (III-l.-A), it is clear that 



13 

21 


which is not p.d. 

Returning to Chapter II, the basic error characteristic equation 
(11-16. B) involves the q^ ratios (p = 1), 
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, n-1 q. . x , n-2 q _ . a 

K(s + H (n-l)n/ s + ... + 4 2n/ s + 4 ln/_ ) 

1 ^nn ^nn H n n 


sA m ( S ) 


(IXI-l.C) 


where K = q K- 
nn X 


q . . = elements of Q 
ij 


n - system order 


By knowing the combination of q..y values possible, an adaptive 

1 1 / 

^nn 

system design can be effected. 


Using 


_ be 

Am T Q+Q\,-| U 


(II 1-2. C) 


a technique is developed in Appendix A for computing Q given C by an 
algebraic technique. The C matrix in (III-2.C) overcons trains the 
problem inasmuch as it is possible for many of the zero terms of (III-2.C) 
to be non-zero and still guarantee that the right hand side of (III-2.C) 
is n.d., but the particular form given simplifies the analytical deriva- 
tion considerably and then allows for a straightforward computational 
technique. 


As shown in Appendix A, (III-2.C) may be expanded into n (n+1) 

2 

independent equations in the n(n+l) q. . variables of the form 

2 1J 


n (n-i+1) 

E E 


i=l J-l 


where a ^ . , f^are constants 


q.. elements of Q 
ij 


which can be generalized into the algebraic matrix form 


A x = b 


(III-3.C) 
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where 


A - r ^ - n *^ - x n constant matrix 
2 2 


x - q 


11 q l2 *“ q ln q 22 q 23 *'* q 2n 


1 T 

“*• q nn 

J - 


b - xl vector of o's and cjj's 

- 2 


(n+1) xl vector 
2 


(III-3.C) defines a set of n(n+l) linearly independent equations so 
, 2 

|a|t* o and A is guaranteed to exist. Solving 


x = A - f.( c ii) 


(III-4.C) 


by iteratively "sweeping" through the ranges of values of the c i;L from 

o + to it is possible to obtain numerical data on the range of values 

of qj- / which, through (III-l.C) have been shown to help determine 
Jn/< lnn 

the zero compensator locations. For the general case, numerical solutions 
instead of general analytical results are much easier to find, although 
for low-order problems general results may be found. 

The "sweeping" of the c i:L is performed as follows: 

Let be a small positive number and 2c^ the diagonal elements 
of C. Initially let c ii = e.^ = e and then iteratively increase c nn to 
some arbitrarily large value then increment c( n _i)( n _i) and sweep 

through all c nn 's. This could be performed by a sequence of nested DO 


loops of the form 
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DO 

10 

I - 1, 

MAXCOUNT 

DO 

♦ 

• 

10 

« 

« 

J - 1, 

MAXCOUNT 

DO 

• 

10 

; K = 1, 

MAXCOUNT 


10 CONTINUE* 

It is possible, for n=2, to obtain exact analytical results 

relating the c and A elements to the q ... ratios, as will be 
ii m ij/ a 

M nn 

pointed out in a later section of this chapter* However, for the 
general case, the analytical computations involved are unwieldly, and 
are best by numerical methods* 

A computer program, QRANGE, has been written to numerically obtain 
allowable root location combinations so that the dynamic error response 
can be easily designed* The program is made up of a series of sub- 
routines which order the data so that a series of root-locus like curves ‘ 
are plotted by the computer showing the location of variation of each 
of (N-l) roots, where N is the system order. This is accomplished 
by using a subroutine titled ARRAYR to order the roots in groups of 
(N-l) from largest to smallest (most positive to most negative) and 
then plotting all first terms, second terms, etc* of each group together* 
To see this, consider that there are a large number of groups of (N-l) 
data points, each group of which is arrayed largest to smallest: 
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Group of 
N-l terms 


(N-l) 


(N-l) 



‘-.1-* 



~-.i 


‘-.i * 


-.5 


retrieve 

-1.7 

order 

-1.3 


-2.3 


> 

V 

ft 

— ^ 

-1.7 


• 



ft 

— ^ 


l 

ft 

L. _ 



-1.3 



-1.7-*- 



ft 


-12.2 

-1.9+J6 



ft 


ft 

-1.9-j6 

ft 



-12.2 


• 

ft ' 







ft 


-1.3 


-76. 

-82. 


Plot 




” - 12.2 
-13.5fjl 
-13.3-jl 


Figure III-l.C. Root Ordering By Groups. 

This operation is performed repeatedly until (N-l) sets of roots have 

been plotted. Then a listing of all groups of coefficients, the groups 

ordered so the first term of group 1 >_ first tern of group 2 >_ first 

term of group 3 ...., is given. 

It is felt that by displaying a representative sample of root 
locations that guarantee asymptotic adaptive error stability, the 
designer can make a judicious choice of some root combination which is 
close to what he desires. Overall error transient response can then 
be improved beyond this by using the methods in [7,11]. 

A brief discussion of the special form of the C matrix used is in 
order. For the Q-ratio determination technique presented, it has been 
assumed that the C matrix is a diagonal of positive numbers with all 
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off diagonal elements zeto, 1 This is a sufficient but not necessary 
condition for C to be p.d. However, the alternative is that, to cover 
all combinations of the C elements for which C is p.d., all off diagonal 
elements must be swept through their ranges of values. This would 
require complete knowledge of all the non-linear relationships guaran- 
teeing C be p.d. a situation that is difficult for low (i.e, 2nd) order 
systems and completely unwieldly for higher (i.e. >_ 3) order systems. 
Therefore, the range of values of the Q ratios obtained with the sweeping 
techniques are a subset of a larger, unknown set. This is not of any 
real consequence because it simply means the designer is forced to select 
his zero compensators from a smaller choice set. Whatever combination 
he does choose will insure an asymptotically stable error response. 

A second point to consider is that of sensitivity of the delta 
increments used in sweeping the c^ terms through in a priori fixed 
range of values. By using discrete step increments the possibility of 
"missing 11 that particular (unknown) combination of c^ values where the 
changes in Q-ratio roots is largest may occur. This is where a bit of 
insight on the part of the designer is needed. A first "guess-run" can 
be performed using estimated limits on the and a delta value to give 

a reasonable number of data points. After a cursory examination of the 
preliminary data a second run with appropriately modified data could 
be determined. 

Such a computer design program is ideal for use on an on-line, 
time-sharing computer terminal system. In a relatively short time the 
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designer has a written and graphical record of results which he can later 
use in a full design study. 

Shown in Figure III-2.C. is a flowchart of the program QRANGE, a 
copy of which is available from the Auburn University Electrical Engineer- 
ing Department. This main program ties in with a number of subroutines. 
QRANGE, the main control program uses MATINV to obtain A - * from A as in 

(III-2.C) and(III-3. C) , then obtains feasible q, . , ratios using MMUL. 

^ Inn 

These coefficients are then transferred to PROOT where all of the (N-l) 

roots of the numerator expression in (III-l.C) are obtained. These 

roots are stored in two large arrays, for real and imaginary root parts. 

RTORDR arrays the roots in groups of (N-l) terms, from largest to smallest 

(smallest negative real part to largest negative real part). Using ARRAY, 

the jth (j=l ,2, . . .N-l) term of each of these groups is retrieved and 

plotted, real part vs. imaginary, using SPLIT. When all groupings of 

each of the (N-l) roots of the qj j / ratios have been plotted, the 

J ' qnn 

entire set of data points is plotted. 

D. Kleinman's Iterative Method For Determination of Bounds on Q Matrix 
Elements 

As discussed in Chapter IV of the Third Technical Report, Kleinman's 
Iterative method [19] includes a subroutine that is a numerical technique 
for solving the equation 

a/q + QA„ = -c 

for Q, given A^ and C. This is an iterative method whose results compare 
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III-2.C. Flowchart of QRANGE 
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with the method discussed in section C. By using this method in a loop 

and varying the C matrix a range of values on the Q matrix elements can 

be obtained. These results then help the designer define regions in 

the s-plane where zero compensators of the error characteristic 

equation in Chapter IX may be placed. 

Whereas the other numerical methods discussed thus far were exact , 

the Kleinman iterative method supplies answers which are only accurate 

to within some tolerance. Therefore, any zero compensator placement 

based on results from this technique would have to be verified to insure 

T 

that Q was p.d, and that A m Q + QA^ was n.d. However, this need not 
negate the use of this method, for it would be expected that only near 
the boundary of a stability region would the approximate iterative results 
differ from exact results. 

Computationally, it solves 

A T Q + QA + C = 0 
m x H m 


by starting with an a priori input initial guess and then iteratively 
homing in on Q to within a tolerance. The tolerance is based on the 
requirement that 


q 1 j (k+l) -q t j (k) 

q ij (k+1 ) 


< TOL 


i - 5 


S t 

where (k+l) is the (k+l) iteration. In this way TOL represents a per 

cent error (0 TOL <_ 1). However, if it is desired to insure that all 
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elements meet precisely the TOL requriement, the program in [19] may 
be easily altered to check all the elements. 

E- Comparison Between Stability Bounds Obtained From Lyapunov Theory 
and Linear Methods 

In actual design work with model-reference adaptive systems it is 

necessary to use only those combinations of qjj/ in (11-16 .B) such 

q nn 

that the necessary stability conditions are maintained* However, the 
whole purpose of the linearization technique performed in Chapter II 
was to reduce all the Lyapunov stability considerations to classical 
control techniques, especially root locus methods. It is therefore 
instructive to compare stability predictions between linear methods and 
the exact Lyapunov methods to see just how well the small-signal technique 
works as a design tool. Through some examples, then, it may be possible 
to develop some "rules of thumb" for various order systems as to deter- 
mining how one can be a bit conservative on the stability bounds for 
the roots of 



(I1W.E) 


as predicted by linear methods and still meet Lyapunov requirements. 
The first example compares the two methods for the special case 


n = 2. 


Example 1. 

Consider the general second-order case of 
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G ( s ) = 
in 


w. 


n 


s^+2?(i) n s+(u n ^ 


A m (s) = s 2 + 2 ?w n s + w n 2 


It is desired to find bounds on the zero "-a" using ( 11-16. B 
case p=l, n=2; 


1 + k(s+a) = o 

s(s 2 +2^i 1 ) n s-h»j n 2 ) 


A is 
m 


0 

1 


’ 0 

1 

2 

" u n 

- 2 ^n 


m 

-a 21 

m 

-a 22 _ 


With 


C = 


2c n 0 


L 0 2c 22“* 


c ll» c 22 > 0 


solving A m T Q + QA m = -C for the q ± .. element, 

cil(a22 m ) 2 + c ll a 2l m + c 22( a 2l m ) 


a 2i ma 22 m 


(III-2.E) 


for the 


(III-3.E) 


<11 = 
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= C 11 


12 „ ® 
21 


{ 22 


_ C 11 + c 22 a 21 


m 


m m 
a 21 a 22 


(III-4.E) 


Defining a = q-^2/ 


^22 


and substituting (III-4.E) results in 


m 


a = 


c ll a 22 


C 11 + c 22 a 21 


m 


(III-5.E) 


Letting c-^i c ^ take on all values between 0 and 00 , note that "a" 
varies between 0 and a ^ ^ • For the second order example this is equive- 
lant to 


0 < a < 2 Coj 
— n 


(III-6.E) 


It should be noted that (III-4.E) was obtained by taking the general 

inverse of A in (III-3.C). Since A is of size n(n+l) x n (n+1 ) , results 

2 2 

become unwieldly for 3rd (A is 6 x 6) and higher order system, and this 
is when a numerical optimization is proposed. 

Using Routh-Hurwitz methods, (III-3.E) becomes 


s 3 + s 3 (2Cuj ) + s (a) 3 + k) + ka = 0 
n n 


(III-7.E) 
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a < 2£io 

n 


(III-9.E) 


From a knowledge of linear systems analysis, (1II-3.E) requires that 
a > 0* Combining these two limits results in 


0 < < (III-10.E) 

— n 

T 

which agrees with (III-6.E) obtained by the Q + QA^ = -C method. 

In some sense this provides a check on the accuracy of the small signal 
error equation with exact Lyapunov methods, for it shows that for n = 2, 
results are identically the same. 

A general third order problem will now be studied in order to com- 
pare linear vs. Lyapunov stability region predictions. As might be 
expected, results are much harder to interpret. 

Assume the characteristic equation for n = 3 is 



(Ill'll. E) 



The linearized error equation from 
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(III— 14 . E) represents the linear characteristic equation to be used in 
comparing stability prediction,. 

Using Lyapunov theory, 



q 

q 

q ' 


0 

1 

0 


11 

12 

13 





Q = 

q 12 

q 22 

q 23 

A = 
m 

0 

0 

1 






m 

m 

m 


**13 

q 23 

q 33 


a 31 

a 32 

a 33_ 


a , m < 0 

nj (III-16.E) 


T 

A 0 + QA = -C 
m in 


0 

0 

Ilf 

a 31 


q ll 

q l2 

q n 


q ll 

q l2 

q n 


0 

1 

0 

1 

0 

in 

a 32 


q 12 

q 22 

q 23 

+ 

q 12 

q 22 

q 23 


0 

0 

1 

0 

1 

m 

a 33 . 


» q i3 

q 23 

q 33. 


q i3 

q 

M 23 

q 33 


m 

a 

. 31 

m 

a 

32 

m 

a 

33 _ 


■ c n 0 


0 

0 


-c 


22 


0 

0 

-c 


33. 


(111-17. E) 


where a special form of C has been selected as discussed previously, 

c >0. Using (III-17.E) , a set of n(n+l) equations in the n(nrtl) 
ii 2 2 

variables q^ is obtained 
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a 31 q 13 + q 13 a 31 " “ C H 

a 31 q 23 + q H q 13 a 32 = 0 

a q + q +q a =0 
31 4 33 4 12 h 13 33 


\ 


23 a 32 c 22 
m 


Solving for q 


in 


j = 1,2,3 


q 12 + a 32 q 23 + q 12 + q 

q 13 + a 32 q 33 + q 22 + q 23 a 33 = ° 

q 23 + a 33 q 33 + q 23 + a 33 q 33 = ” C 33 




/ 


(III-18.E) 


q 13 = ' C 


11 


2a 


31 


— c a„„ - c, , + c a„ _ 

22 33 11 33 33 23 33 


q 23 = “ C 33 + 


‘31 


(III-19.E) 


4(a 31 + a 23 a 33 ) 


c 22 + C 11 a 33 " c 33 a 23 


*31 


q = 

M 33 


2(a 31 + a 23 a 33 ) 


Using the ratios q 


13/q 33 ’ q 2 3/ q 33 


and the c. . one can obtain combinations 

li 


of q n / , ^91/ such that asymptotic stability of the error equation 

1J/ q 33 ^33 

is maintained. The roots of 


(= 2 + < 23 /^ S + ^ 13 / qj3 ) 

may then be obtained by using (III-15.E), and it is these roots which are 
to be compared with the zero placement from linear methods. 



8 (1) + s (2£u) n +p) + s (w n +2f;a) p+K) + s(u) n p+K(a+b) + Kab 



(u) n ^+2^ n p+K)| (Kab) 


(2Cw n + p ) 


<*> n p+K(a+b) 0 


(2cu n +p) (w n 2 +2Cw n p+K) - u n 2 p+K(a+b) 
(2Cw n +p) 


(Kab) 


(2cw n +p) (o) n 2 +2co) n p+K) - oj n 2 p+K(a+b) 


o>n p+K(a+b) - (Kab) (2i> n +p) 
(2ct*) n +p) 

(2c<A) n +p) (o) n Z +2^(o n p+K) - co n 2 p+K(a+b) 
(2^w n +p) 


, p , a, b > o 


Figure III-l.E. Routh Hurwitz Array for Third Order G^(s) 
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Using . (III-12 .E) , the characteristic equation to be studied by 
Routh-Hurwitz array is 


2 2 

s(s+p)(s +2tw n s+w n ) + K(s+a) (s+b) = 0 

or 

+ s^(2?co n +p) + s 2 (u) n ^+2c;u) n p+K) + s(w n 2 p+Ka+Kb) + Kab = 0 

(III-20.F) 


The corresponding Routh-Hurwitz array is given in Figure III-l.E. From 
column 1 of this figure it is necessary that all entries be positive in 
order to insure stability, so 


£,a> n ,p,a,b > 0 


(2ca> n +p) (w n 2+2£a) n p+K) _ (u^p+Ka+Kb) > 0 


(a) 

(b) 


K > 0 


(co n p+Ka+Kb) - 


(Kab) (2Cw n +p) 


> 0 


(c) 

(d) 


J 


(2£u) n +p) (u) n +2£io n p+K) - (cu n p+Ka+Kb) (III-21.E) 


Since £ , w n , p are known, it is a, b and K which are variables to be 
related. Since K must be greater than 0, (b) and (d) of (III-21. E) can 
be combined as follows. From (b) 


if 2Cu> n +p > a+b then K > 0 

2 2 

if 2£to n +p < a+b then K > 2£w n (w n +2£to n p+p ) 

a+b-2£oo n -p 
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(d) is in the form of a quadratic in K, which can be seen by rewriting 
it in the form 

AK 2 4 BK 4 C > 0 (III-22.E) 


where 

2 2 

A = 2£ur b+a +b -a -2ab-b 

n n. P P 

2 2 
B » p (u n ) (2C0J n +p-(a+b))-ab p 42?u>n 2ab p -hon (a4b) 

2 

+ 2sa) n p(a+b)+p (a4b) 

2 2 2 

C - 2?aj n pu) n (u) n 4250)^4? )-2£u n ab 

If either (a) the discriminant B 2 - 4AC < 0 or (b) all roots of (III -22. E) 
are negative then for K positive (III-22.E) is satisfied. Statement (a) 
can be seen by considering f(K) versus K, where (III-22.E) can be written 
as 

AK 2 4 BK 4 C > 0 = f (K) (III-23.E) 

2 

If B - 4AC < 0 then there are no real roots and (for A > 0 the parabolic 
function has a minimum greater than zero. Statement (b) allows for 
negative crossings of the K axis, such that for all K > 0, f(K) > 0. 

This is illustrated in Figure III-2.E. 

In order to illustrate the types of stability bounds which can be 
expected from Lyapunov techniques versus linear methods using (11-16. B) , 
a third order example will be given. 



91 


f(K) 



Figure III-2.E- Illustration of f(K) vs. K Requirement 
for ( 111-23. E) 
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Example: 

G m Cs) = (s + 1) (S + 2) (s + 3) 

Q and of the form in (III-16.E) 

, . k(s + a) (s + b) _ n 

s(s + 1) (s + 2) (s + 3) 

is the error characteristic equation of interest. Using Routh Hurwitz 
linear stability methods, a region of a, b zero placement can be 
determined. Using exact Lyapunov techniques, a stability region for 
a, b placement was determined using QRANGE. The results of both the 
linear and Lyapunov stability regions are shown in Figure III-3.E. 

Some Important points to note from Figure 111-3. E are (1) as 
expected, Lyapunov-obtained results are more conservative than from 
the approximate linear methods, (2) the Lyapunov stable-region is 
clustered near the origin with respect to linear results, (3) no part 
of the Lyapunov predicted region is outside that obtained from linear 
methods, suggesting that the Lyapunov results are a subset of linear 
results. In addition, it appears from both second and third order 
examples that a "rule-of-thumb" might be that some fraction of the 
linear stability region would fit Lyapunov conditions. Results would 
have to be interpreted carefully, however in order to insure stability, 
but as a starting point for compensating design the rule-of-thumb 
might be used. 



s 2 + q 2yq. 33 s+ q l^/q 33 = 0 
Root 2 



Figure III-3.E - Allowable "Zero" Root Locations Guaranteeing Asymptotic Error Stability 


IV. PRACTICAL DIFFICULTIES IN IMPLEMENTING AN MRAS CONTROLLER 


In Chapters II and III design criteria and stability analysis were 
discussed and a number of examples given to illustrate implementation. 

Up until now, the "ideal" case was assumed, i.e. no plant or input 
noise, all plant states measurable and available for feedback. In most 
practical situations one or more of these conditions will be violated 
to some extent and the purpose of this chapter is to study such effects 
on the performance of an MRAS controller. Analytical results will be 
presented when possible and examples given to illustrate discussion 
topics. 

A. MRAS Controllers With Noise 

Noise is an imprecise term which is often used in practice to 
account for modeling uncertainties, undetermined environmental dis- 
turbances, and linearization effects of non-linear system. Noise 
will be considered in this section in regard to its effect on stability 
of error in a model-reference control system. 

In particular, a plant with input noise and state noise will be 
studied. The state noise could conceivably represent the effects of 

(a) electrical noise 

(b) vibration 

(c) measurement transducer misalignment 
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(d) random wind gusts 

(e) bending moment effects on measurement transducers 
Input noise could be represented by 

(a) mechanical play in control guides and surfaces 

(b) electrical noise in drive signal due to induction pickup 

(c) wind disturbances on control surfaces 

Shown in Figure IV-l.A is a diagram of the plant of an MRAS 
controller subjected to input noise \^(t) and state noise _n(t) . Using 
Lyapunov theory and the Lyapunov functions in [5, 6, 7] an analytical 
description of an upper bound on the norm of the error in steady-state 
will be found. Asymptotic stability no longer has meaning when noise 
is present; instead bounded stability is of concern. The dynamics 
given in Figure IV-l.A will now be discussed. 

The disturbance inputs are 

i - 9(t) v + A(t) £ ^(t) = f(.)4 (input) (IV-l.A) 

A = r(t) n + nt) w m(t) - f (•) o (state) 

where 

-£.» — are nth order gaussian-white uncorrelated processes 
with zero mean 

v(t), n_(t ) are correlated noises 

_f ( •) is a saturation function which clamps at the ±3cr values 
of the appropriate gaussian input 


The plant dynamics are 





K S (t) 

i 





Figure IV-l.A. Adaptive Controller With Stochastic Input and State Noiee Present. 
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2p = A pCt) 5p + K ( fc ) [kp + + B p (t) £r + v(t)] (IV-2.A) 

where 

Xp is an nXl state vector 

r is an rXl input vector 

K(t) is the adaptive gain matrix 

Ap (t) , Bp (t) are nXn and nXr unadapted state and input matrices 

Defining 

Xp (t) “ % + n(t) (IV-3.A) 

u(t) = £(t) + \>(t) 

Xp, u(t) represent the available plant information. Substituting 
(IV— 3. A) into (IV-2.A) results in 

^ - Ap(t) Xp + K(t) ^(t) + Bp(t) u(t) (IV-4.A) 

which is similar to (II-l.A) except that now the internal feedback 
A(t) Xp is separated from the external, physically available K(t) Xp(t) 
which is corrupted by noise n(t) . Since a control law must be 
implemented with available state information, a new error variable 

(IV-5.A) 

is defined. Since the noises cannot be controlled but only identified 
by their statistical properties, the effects of them on the MRAS 
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controller performance are important considerations. In Appendix C 
is developed an analytical expression for determining the error bounds 
as a function of the input and state noise statistics, and certain 
adaptive gain parameters . Two such independent studies have been 
performed in recent times [9, 10]. 

9 

Using the V function given in Chapter XI, V is determined in 

Appendix E for the case of additive noise. The results are that V 

* 

is p.d. but V is indefinite. 


n n 


V = £ T (A^ Q + QA m ) i- 2? E, » 


n 


i=i j=i 


ij 


r=i e k q ki x pj 


n 


-2£ E 

±=i j=i 




n 


IE e k q kl u 

k=l 


2 + 2 ; T Q 


V - ” i ~ Vi 


tIV-6.A) 


If the noises were not present, then V would revert to a function 
n.d. in e_. For the case of noise assuming that v_, n_, and n_ are 
bounded, the last term of (IV-6.A) can be written as 


2 | |A 


T) 

P _ 




max 


< r 


(IV-7.A) 


Defining 


V! = £ T (4q + QV e-2E t hi 

1=1 j=l 



-,2 


Vki* 


Pj 


n r 

' 2 Z Z fi ij 

i-1 J-l 


n 


z Vki u j 

k=l 


(IV-8.A) 
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and using (IV-7.A), 

V < v x + | |e T q| | r 


(IV-9.A) 


since the second term of (IV-9.A) is equal to or more positive than the 
last term of (IV- 6 .A). Using a procedure outlined in [ 9 ] an upper 
bound on the norm of the error is found to be 



A(Q) 

> 


max 


x(-a* Q - QV mln 


r = p 


(IV-10.A) 


where 


*^max t ^ ie max i inuni eigenvalue of Q 

^(-A ffi Q - QA m ) min is the minimum eigenvalue of (-A^ Q + QA m ) 

T is defined in (IV-7.A) 

p = radius of convergence of n-dimensional hypersphere in 
e-space. 

(IV-10.A) says that as long as the norm of the noisy error, | |e| | , is 
greater than the analytically derived number p, then V will be n.d. in 
— and the MRAS controller will guarantee bounded stability to at least 
an error region with norm p. It could be that the norm of the error is 
considerably smaller, and in fact may approach zero, but no concrete 
statements can be made for | |ej | < p. 

Using 

(IV-ll.A) 
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an upper bound on the norm of the error 

e = x - x 

— ■— HTI '■ ■ p 

can be found, 

ll±ll £ Mill + llalL, (IV-12.A) 

I I el I < P + I lal - • (IV-13.A) 

(IV-13.A) gives an upper bound on the "steady-state" error, i.e. what is 
the smallest difference between plant and model states in the presence of 
noise. This is illustrated graphically in Figure IV-2(a,b,c) . A. In (a) 

C is a typical phase plane trajectory. As long as C is outside the circle 
with radius p, then V is p.d., V is n.d. and the error continues to 
decrease. It may be, as shown in (b) that C may enter the circular 
region of radius p; it is simply that in general, using (IV-10.A), nothing 
more than bounded stability with | |e ] \ < p can be made, (c) shows 
how (IV-10.A) provides an error band on the state x^(t). This is 
similar to the ±lo limits used to describe probability accuracy bands 
for various states for systems corrupted by Gaussian noises , except 
that the error bands shown in dotted lines give the best "steady-state" 
tracking results which can be expected between the model and plant 
after a plant disturbance has occurred. 

The error region given by (IV-13.A) will represent an upper limit 
for the worst-case condition. In general, the actual errors involved 
would most likely be much less. The form of the error bound in (IV-13.A) 





Plant trajectory 



Figure IV 2. A (a) Error Trajectory C showing circular region of conver- 
gence predicted by (IV-10.A)* (b) trajectory C may enter circle of radius 
s (c) how p enters the physical problem by providing error bounds on x. (t) 
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leaves much room for Interpretation of Its meaning. This is because the 
error bound is on the norm of the total error vector, not an error 
bound on any individual error state. Consequently, an inexact procedure 
of weighting the errors, based on simulation or other external infor- 
mation, might need to be used to obtain an estimate of the. proportion of 
the normed error bound due to any one state error. 

Example: 

Third order system in phase variable form corrupted by noise 

From a priori information, it is known that the errors are 
apportioned approximately on the basis 

n a p 

1 3 norm 

e 2 K T e 

*■ 3 norm 



From design information it is known that 

UQ) =1 

x max 

X(-A T Q - QA ) . = 4 

m x ^ m min 


r = .4 
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Because the error bound with noise Is given in terms of matrix 

related values, i.e. eigenvalues, no general relationship exists at 

present between, a particular choice of a Q matrix for a given model 

and the resulting upper error bound given by (IV-10.A) and (IV-13.A). 

It is of course true that the largest eigenvalue of Q is a function 

of the magnitude of the elements of Q, but using small values to 

minimize X(Q) in no way insures that X(-A Q - OA ) . is large: it 

m m min 

is the ratio which counts, not an individual term. 

Although no general n th order relationship exists for relating the 

T 

choice of the Q elements to the resulting KQ) max and M-A^ Q — QA m ) min 
values, exact results for a 2 nd order case can be developed and will 
now be outlined. 

Consider the general 2 n order model 


~0 

1 



^12 

m 

m 

with Q = 

L a 21 

a 22_ 


_ q 21 

q 22. 


a 2l’ a 22 < ^ ^° r 3 8ta ^^ e ®°del. It is desired to determine a relation- 
ship for expressing the ratio 


A(Q> 


max 


Q - QV 


(IV-14.A) 


as a function of model parameters 
To determine the eigenvalues 


and the adjustable 
of Q, 



elements* 


fXI-Q| 


A-q u 

~ q 12 

_q 12 

X “ q 22 




(IV-15.A) 
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which reduces to the characteristic equation 


x 2 + H-q u - q 22 ) + (q u q 22 - q 12 ) - o 


which has roots 


, , _ (q ll + q 22> 1 ~\A q ll + q 22 )2 ‘ 4( 1ll < J22 " q 12> 

V A 2 2 


Dividing and multiplying by q22> (IV-16.A) can be put in the form 


X l* X 2 = ~T- (1 + b) ± 


I 2 ? 

(1 - b) + 4a 2 


where 


- = zero compensator location as given in (11-16. B) 

Qrt « 


For Q to be p.d., both roots of (IV-17.A) must be positive, so the 

limiting case is for A = 0, or 

min 


(1 + b) = V(1 - b) 2 + 4a 2 


which reduces to 


v 2 

b = a . 


In general, 
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b > a 


(IV-20.A) 


Similarly, for (A^ Q + QA^) , 


A Q + QA * 
m m 


(2 <12 a 2?> 


^ q 22 a 21 + q ll + q 12 a 22' ) 


( q 22 a 21 + q ll + q 12 a 22 ) 


2(q + q a m ) 

4 12 4 22 22 

(IV-21.A) 


with the relation 


A Q + QA = -C 
m m 


where C is p.d., the eigenvalues of C are 


XI-cj = 


(A + 2q 12 a 2 “) 


(q 22 a 21 + q ll + q l2 a 22 ) A + 2(q 12 + q 22 a 22> 

(IV-22.A) 


m. 


(q 22 a 21 q ll + q 12 a 22 J 




from which the characteristic equation is 


x 2 + X(2q 12 + 2q 22 a 2 ” + 2,^) + |*qJa 2 J + 4<l 12 q 22 a 2 "a 2 " 


in 


( q 22 a 21 + q ll + q l2 a 22 


? 2 ] -0 


(IV-23.A) 


Solving for the roots of (IV-23.A) and rearranging terms. 
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Both (IV-17.A) and (IV-24.A) are similar in that the roots are a 
function of constants and ratio of elements, and the magnitude 
of q 22 . It is the numerical value of q 22 , then, that determines both 
sets of roots, given that an a and b have been picked. 

From (IV-17.A), ■ 



(IV-25.A) 


and from (IV-24.A) 



(IV-26.A) 

From (IV-25.A) and (IV-26.A), the desired ratio 



HQ) 

max 

H-A T Q - QA ) . 
m m min 


can now be formed, 
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KQ) 


max 


[ (1 + b) + ~V(1 - b) 2 4-^T 2 ] 


= L(i + b) + v q - b)‘ 

m i, 

‘22 + aa 21 


X( " A m Q ' 2 |-(a + a„” + aa„”) * 


-V < a + a 22 + aa 21> 2 




4a 2 a m + 4aa m a m 
Ha a 21 + ^aa 2 i a 22 


< a 21 + b + aa 22 

(IV-27.A) 


? 2 1 } 


For a given model, the ratio 


A(Q) 

max 

x(-a t Q - QA ) 
m x m 

may be plotted as a function of a with b as a parameter. Since for the 
case of the model in phase-variable form no information about is 

available, in practice only a single curve with b = e, e > 0 is needed. 

4 - 1 - 

Lacking a general relationship for an n order system between 
the selection of the Q matrix and the error norm bound does not mean 
that nothing can be done. Using (IV-10.A) and (IV-13.A) for a particular 
choice of Q will supply a bound on the indeterminacy due to noisy states 
and inputs. If this bound is sufficiently small with respect to the 
range of values of states expected, then the given Q values should be 
sufficient. If not, a brief "trial-and-error" study of adjusting 
the Q matrix and determining the error bound from (IV-13.A) may provide 
an empirical relationship which may be used to home In on an acceptable 
Q matrix. 
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Example: 


Given the 2 n< ^ order model 


G m (s) (s + 1) (s + 2) 


(IV-28.A) 


It is desired to determine the Q matrix in order to implement the 
adaptive gains for the plant 


G (s) = — 
P 2 


(IV-29.A) 


s + a2|s + a 


zl 


Assuming there are large noises on the input and state measurements, a 
trade-off between the error transient response, as discussed in Chapter 
II, and the noise-present system, discussed in Chapter IV, is necessary. 
Placing the model in phase-variable form 


Am" 



-2 


1 

-3 


(IV-30.A) 


it is desired to determine 


q ll 

q 12 

q 12 

q 22 


Using analysis and design procedures from Chapter II, the noise-free 
error transient response is determined by (using [6]) 


(s + a) (s + d) 
s(s^ + 3s + 2) 


1 + k 


(IV-31.A) 
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where 


k q 22 K 2 


a 




and 


0 < a < 3 

Based on a noise-present design, given that the noise cannot be reduced 
it is important to minimize the effects of the noise. From (TV-10. A) 
and (IV-13. A), by minimizing the ratio 

HQ) 

— (IV-32.A) 

Q - 

the controllable effects of noise on the plant are optimized * Using 
(IV-27.A) with b as a parameter. Figure IV-4.A shows the relationship 
between (IV-32.A) and the choice of "a". As is evident from Figure 
1V-4.A, a trade-off between the desire for a large ,r a" for good transient 
response versus a small multiplier ratio as given in (IV-32.A). As 
a compromise, M a ,! - 1,5 was chosen. This results in the error root 
locus given in Figure IV-5.A. 





Figure IV-5.A Error Root Locus For Example With Stochastic Noise. 
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In Figure IV-6.A are shown the results for two runs with different 
noise combinations and these in turn are compared with a deterministic 
run. Using (IV-13.A) | |ej | - .4 assuming the error contributions are 
equal between e^ and e^, the maximum error (e^) should be less than 
.283, or about 5.6%. The actual results show the steady-state errors 
in two cases to be less than .025 with an input of 5u(t). The noises 
were correllated by passing Gaussian white signals through magnitude 
limited ±3o, low-pass filters with 10 Hz bandwidths, where bandwidth is 
defined here to be the frequency range where |cj > -60 db (gain of 
1/1000) . This stringent requirement on the definition of bandwidth was 
chosen so that when some maximum value of the state noise rate, n, was 
analytically determined then the resulting analytical bound would be 
accurately reflected in the actual error bound. | n I j. s determined bv 

klma*' 2 * < 4t l> llil max - i- 1. 2. - 

where 


Af^ - bandwidth, Hz 

| n j - maximum value 
max 

As would be expected, the actual error bounds were much less than the 
predicted ones. 

B. Parametric Study of the Error Bound As a Function of the Noise Bounds 

In this section, a form of sensitivity analysis will be performed in 
order to obtain relationships between changes in peak values in the 



Error 
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* .0025 

(Predicted = .4) 


Figure IV-6. A. Adaptive Error Response With Stochastic Noise Present. 
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noise states, determined by the ±3a limits, to the normed error bound 
given in ( IV-1 3 . A) , 



« - OVmin 






max 


(IV-l.B) 


where the various terms are described in section A. The interest in 
this study comes from practical considerations wherein the noise 
statistics, i.e. mean and standard deviation, are often directly related 
to the type of hardware used in the controller. Such hardware would 
include type of measurement transducer, transducer mounting integrity, 
types of electrical shielding employed, amplifier linearities and drift 
(if analog hardware employed), number of bits and D/A, A/D accuracy 
(both time and magnitude) if digital implementation is used in the 
controller. 

For purposes of this study, each noise source, either or may 
be depicted by a bound on its peak value, whether it be plus or minus. 
Thus if has a mean of 2 and a of 1, its peak value could be con- 
sidered to be 5 or -1, whichever maximizes (IV-l.B). 

It is assumed that the Q matrix has been selected and is fixed and 
only changes in the noise statistics are to be considered. Consequently 
( IV-1 . B) becomes 



55 c yi + y 2 


max 


(IV-2.B) 
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where 


C - constant 


y x = 2 1 i A 0 n. " n. - 


m— 1 'max 


y 2 ■ I lnl I 


max 


V 2 2 2 

a l + a 2 + * ’ ’ a n 


Since A Q is in phase variable form, A Q n_ is in the particular form 


a 0 IL = jn 2 . n 3 , ... n n _ 1 , nJ 


(IV-3.B) 


where 


N - - a n _i r 1 2 > • • • ~ a l n n) 


A in the form of A in (11-15. B) 
o 


rj is determined by the band-limited nature of the noise, i.e. 


= 2tt f 


(IV-4.B) 


max 


max 


oax 


where 


f max ~ arbitrary frequency cut-off point 

r]j determined by mean and 3a limits 
nnax 
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max 


- the incremental change in the peak value of the 
noise state v. (determined by the mean and standard 
deviation) 


Often the relative change, in %, of the error is important and this is 
determined as in (IV-7.B): 


Ae r 3 e Av . 

norm — l max J 

e norm :5=1 _ 3v j e norra _ 

l 

where e^^ is computed at the nominal noise state values. 


Example: 

An increase in cr of 1.0 for all noises is contemplated as it has 
been determined that by doing so electrical cable shielding costs can 
be reduced by 50%. It is desired to determine the maximum expected 

increase in error due to this change. 

The existing conditions are as follows 


- r 

0 0 

B “ = 

2 3 ^21 ^22 



v^: \i : mean = 0* cr = 1.0 
V 2 ^ mean - 1.0 a = , 5 


C = .005 
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Using (IV-5.B), e before the change is 

norm 



- — 

0 


v i 

— 

3 (p. + 3o 1 ) "] 

enorm = ( 2 > (-005) 



max 


1 1' 1 


(2v x + 3 v 2 ) 

max 

v 2 

max_ 

B 

2.5 (p 2 + 3a 2 )| 


e = .135 
norm 


Using (IV-7.B) the change la e _ due to changes in a-, and a 0 is 

norm ^ i z 


Ae = (C) 
norm v J 


^21^2l v l + ^22 v 2^ v l + ^22^21 v l + t»22 v 2^ v 2 


V^IV! + 


Ae norm = 


b 22 v 2 ) 

(1V-10.B) 

(.005) 2 (2(3) + 3(2.5)) (3) + 3(2(3) + 3(2.5)) (B) 

2(3) + 3(2.5) 


Ae norm - “ - P - 75 


Using (IV-9.B) the relative error increase is 


Ae norm 

e norm 


^25 ~ 55 >5% increase 


This means that the new error bounds would be +.21. Assuming that the 
control system were part of an attitude control system of a spacecraft, 
this could mean that as an upper bound on the position accuracy, e^j^ 
before the change was such that the error was ±7.7° (57.3°/ ra( j) and 
after the change was 12. I 8 , an intolerable situation. Depending on 
how the errors are "weighted" (shown here all the error was assumed 
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due to e pos i t i on ) > the contemplated change could possibly result in 
extremely sloppy position accuracy. 

Now, the case of both state and input noise will be considered, i.e. 

V 0. The results will be found to be similar to (IV-2.B) thru 
(IV-9.B), although more involved. A sensitivity relationship for the 
error is developed similar to (IV-7.B) 


9e norm . . , 9 " orro 

li + An 2Tnax + • • ' + 

J-max 3n max 3n n 


^ax 



w norm ^ 

Av-. + ‘ Avo + . . . + ~ 

max 3 v 9 max 9v 


(IV-ll.B) 


The partial derivatives can be determined by expanding (IV-l.B); from 
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also 


I Ini I _ + n 2 2 + • • • + n n 2 (IV- 13 .B) 



(IV-14.B) 
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nominal 

if j=n 



where T , , is found by evaluating (IV-12.B) at the nominal 

nominal 

operating condition (before a change occurs). Similarly as in (IV-9.B), 
a relative or % change in e nonn can be determined by dividing both 
sides of (IV-ll.B) by e norm evaluated at the nominal value. Inasmuch 
as (IV-ll.B) thru (IV-16.B) appear so formidable, an example will be 
provided to illustrate their implementation in a practical problem. 
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Example: 

The effect of using a new tracking radar system for altitude 
determination is being studied to determine what gross improvement 
in positional accuracy can be obtained. The system is to be part of 
a satellite launching missile inertial guidance system. From a study 
of the overall system, it has been determined that the standard deviation 
of position error can be reduced by half, although the new system 
costs 50% more than the old unit. The reduction in the overall error 
bound is desired to be found. 

The basic missile information is as follows: 



(IV-17.B) 


u “ 10 6 (1 - e ’005t^ ^ where u is to place the missile in a 10^ feet 
(- 200 mile) high orbit. 

C = 1.4 from a priori design of the Q matrix 


Noise Statistics 


v: y = 0, o v = 333.0 ft. 

n: u =0,o = 1800 ft. 

n l n l 

u = 10 ft. /sec. , o 
n 2 n 2 


= 100 ft. /sec. 
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n Bandwidth = 0 hz. 

1 

^2 Bandwidth - 10 hz. 


The plant-model dynamics and the additive noises are shown in flow 
diagram of Figure IV-l.B. The basic earth-to-orbit configuration for 
the missile is shown in Figure 1V-12.B. 

Using (TV-12. B), 



= 43,650 


Using (IV-14.B), 


3e norm (1.4) (-4) [(>4) (5400) - 5(310) - 2 tt(10)(310) - (1000)] 



Bti-l 


r 

A nom 



= 5.6 


Using 

(IV-15.B) 





(1.4) 

[(-4) (5400) - 5(310) - 2ir(10) (310) - (1) (1000)] 


9n 2 


^nom 



- 1.4 


Using 

(IV-16.B) 
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3e 


norm ^ 


8Vi 


1.4 


With only Improved, 


Ae, 


norm 


norm 

8x1, 


(Am) 


Ae norm = (5.6) <-2700) - -15,100 


Using (IV-2.B), the new e^rm is 


enorm = (1.4) (43,650) +"^(5400) 2 + (310) 2 "- 15,100 


e„ rtMB « 51,300 
norm 7 


Assuming the error contributions to the error norm are proportional to 
the state noise standard deviations, the error in altitude measurement 
is improved from 62,800 ft. down to 48,400 ft. 

Adding a new radar unit may necessitate a new computer and wiring 
system, resulting in cr v increasing by 10% and by 5%, in which case 

^norm = + <*n 2 > + <*>!> (W-18.B) 

1 2 

^orm = "15,100 + (1.4) (100) + (1.4) (2ir) (15) (10) * -13,640 
which results in very little change in the error distribution from 


before. 
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C. Incomplete Adaptatation and State Feedback 

In many situations it may not be practical or possible to measure 
all the states of a system, or the available signals may be too noisy 
to use for feedback to the adaptive controller. In such cases incomplete 
state feedback, incomplete plant adaptation, replacement of certain plant 
states with model states, and state estimation are some of the remedies. 
However, the theoretical problems of stability then arise because, in 
most cases of the Lyapunov-designed type controllers discussed, the 
theory required all plant terms adapting and all plant states available. 
Any changes in the requirements of the states requires an analysis of 
the Lyapunov V and $ functions to ascertain stability. 'It should be 
pointed out that when developing adaptive controllers according to 
Lyapunov theory, modern stability theory such as the Circle criterion 
and Popov Criterion cannot be used directly on the plant but instead 
investigation of the V and V functions and application of the Lyapunov 
stability theorems must be employed. Also, any results obtained will 
be a statement of fact or an overstatement of fact . The latter is 
because sufficient but not necessary conditions are obtained with 
Lyapunov theory. 

In the case of incomplete adaptation, some work has been performed 
to determine bounds on the norm of the error. Results, however, are 
scarce. 

For the adaptive rule in [5], an upper bound on the norm of the 
error has been developed [10] for a special case. Consider the single- 
input single-output system 
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x — Ax + Bu + Cr 
"P P"T P P 

(plant) 

(IV-l.C) 

2m = + B m u 

(model) 


e * x - x 
— -m — p 

(error) 



where 



are constant unknown parameters 

x is an nXl vector 

r is a scaler Input 

u is an adaptive feedback signal 

Using (IV-l.C), 

A " + Axp + Sr - B p u 



(IV-2.C) 
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When all plant parameters are not adjusted, an upper bound on the norm 
of the error is 

i 

Mll »(»», 2 l^nll + l ? nMi| 

\\e\\ £ 

UQ) ndn 1-2 -yjrm q ln |6* ni | 

■ 

and (1-2 "\/nm 9-jjj I ) > 0 is a sufficient condition for a region R e 
guaranteeing boundedness of the tracking error. Where 


(IV-3.C) 


X(Q) max »^(Q) m in are the maximum and minimum eigenvalues of Q 
(see Chapter II) 

^in = max j^in una dapted parameters- i 

! h^ | = max jh^t) j 
i»t 

m = number of unadapted plant terms a^; m <_ n 

If there is complete adaptation then m = 0 and <$ n does not appear in (iV- 
3.C). Then | | ej | = 0 in steady state and the error is asymptotically 
stable in e. 

In another study [9], a different adaptation rule was used than 
the one previously discussed and sufficient conditions developed to 
guarantee asymptotic stability when all of the plant states are replaced 
by corresponding model states. In general, results are scarce however. 


D. An Adjustment Technique For Obtaining Time-Invariant Error Dynamics 

In Chapter II a design procedure for selecting the various adaptive 
gain parameters for a class of model-reference systems was outlined. 
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This technique required that step inputs only be applied to the system, 
a severe restriction in terms of practical utility. However, simulation 
results have shown that for slowly time-varying inputs the method does 
have some design utility. In this section an appropriate modification 
is offered to obtain fixed error dynamics despite a wide range of in- 
put values. The method still guarantees asymptotic stability of the 
system error because all of the original Lyapunov stability conditions 
are maintained. 

As given in Chapter II, the basic perturbed error characteristic 
equation is 

( 11 - 16 . B) 



Similar to (II-ll.B) and (11-16. B) it can be shown that, before sub- 
stituting model states for plant states and setting x^° = 0, j = 2, 3, 
. . . n, the lumped gains are of the form 


n r o £ r 

*1=2 a ni x ip (t)Z + £ ^j<Y)Uj(t) Z 

1-1 L J i L 

n r „-t l r O 

k 2 = £ Pn^io^ 2 +D V 6) Vt> (IV-l.D) 

i=i L v J j L J 

£ 

K3 “ 2 Pn^ip^^ + 2 (t) 

i=i L J j l J 


where 
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j 


(*) - represent a sum of terms of (•); adaptive gain 

I constant for j tl1 adapted input 


xj° ~ represent steady state operating conditions on which the 
111 derivation is predicated 

Z 

” means a sum of Z terms not necessarily in consecutive order 
j (only adapted terms of B p appear here) 

Uj - input 


Z <_ r, the number of inputs 


and it has been assumed that x. (t), U. (t) are functions of time. Note 

■^P J 

that for constant inputs the in (IV-l.D) reduce to those expressions 
given in Chapter II, (IV-l.D) being a more general case. Factoring, the 
numerator of (11-16. B) becomes 


n 



J-l 3 


£ v 1-1 

k=l 


v 

k n (s + Z.) 

i=l 


(IV-2.D) 


where 

v ± n + 1 (depends on type of adaptation) 
Z ± - zero compensator location 
k - root locus gain 

(11-16. B) then becomes 


k n (s + z.) 

1 + -J=1 — - 

S V S > 


(IV-3.D) 


The Z. are functions of the ratios of q in/ i = 1, 2, ... n and of the 

' ^nn 
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ratios » k 2/ > etc * 1116 root l° cus S ain k 18 3 function of and 

% 

k - Wh 


where is either K^, , or K-j depending on the adaptation method. The 

o 

design theory says that, for a given set of constant inputs U^, there 
will be a set of error poles determined by (11-16. B) which tend to de- 
scribe the error dynamics. For different input magnitudes, k will change 
and the closed loop roots will move along a fixed locus. Since the U^'s 
are used to drive the system and will not be known a priori, the 
resulting will vary in an unknown manner, determined by x ip and the 
U^. If it were possible to keep the closed loop error roots fixed while 
varied, then time-invariant error dynamics would result. 

There are two means of obtaining this result, both of which are 
illustrated in Figure IV-l.D. In (a) is shown a single set of loci, 
determined by the placement of the zeroes of (IV-2.D). Since varies, 
if q nn could be adjusted to keep in inverse proportion to K^, then as 

long as the ratios qi-i / stayed constant, the closed loop poles would 

/f lnn 

remain stationary on a fixed set of loci since k would remain constant. 

A second technique would allow for varying q^j (and type) ratios and 
magnitudes in order to keep the closed loop error roots as a solution 
of the root locus of some configuration of the form in (11-16. B). In 
order to effect this , some sort of "pseudo-identification" technique 
would be required to ascertain where the open-loop zeroes should be 
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located in order for the closed-loop error poles to be a valid 
solution of the loci. 

The first of the two techniques is of interest here, both from 
a practical as well as theoretical standpoint. To illustrate why the 
second method is not a practical approach, a brief example will be 
given illustrating how the solutions of Figure IV-l.D were obtained. 

Example : 


1 + k(s + a) (s ± (s t . c) = 0 (IV-4.D) 

sA (s) 
m 

A m (s) = s 2 + 2s + 2 

It is desired to force the closed-loop error roots to be at 


P x = -4 P 2 = -6.449 p 3 = -1.551 (IV-5.D) 


To do this it is necessary for (IV-4.D) to be the roots of 


2 + ka + kb + kc^ 

J2 , 

\ 

2 + kab + kac + kbc 

(1+ k) j 

! S T 

^ <1 + k) | 


s 


+ 


I 

I I + k / 


0 


(IV-6.D) 


where for this example two of the three zeroes in (IV-4.D) are due to 
ratios of a, B, p, y, 6, and o. Either one or more of the zeroes a, b, 
c must then be determined in order to keep (IV-4.D) as solutions to 
(IV-5.D) as k varies. The a, b, c can be found by iterative solution, 



1 2 

s J + ps + qs + r = 0 
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s, = A + B + £■ 

1 3 

A + B| 

1 | 

A + B 1 

2 ) 

By computing k, a, b, and c are determined such that (IV-6.D) are equal 

to (IV-4.D). It is clear the technique requires an iterative non-linear 

technique to obtain a set of possibly non-unique zeroes a, b, c. 

Complexity and computation time are severe drawbacks to this technique. 

A more straightforward adjustment method is the first one discussed. 

It will be shown to involve a straightforward algebraic technique 

suitable for on-line computer use. 

Using linear design techniques, an appropriate root locus gain 

k may be selected to obtain an acceptable transient error response. 

This gain in turn fixes the closed-loop error pole locations. Since 

K^t) varies with the inputs, in order to keep k constant then q must 

^nn 

vary inversely to K h (t) 
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_ desired (IV-9.D) 

V'> 

where Is K 2 or K 3 depending on the adaptation method. Since 
x^Ct), Uj(t) must be available to implement the basic adaptive gain 
equations, and the 4^ are a priori fixed, then there is no difficulty 
with physical realizability of (IV-9.D), where ^ is given in (IV-l.D). 

The case when is zero, the regulator problem when all are 
zero, must be considered. In this case (IV— 9. D) would become singular 
and » <*> would result, an impossible situation. A simple means of 
skirting this problem is to place a saturation operation so (IV-9.D) is 
replaced by 

- i#T sat( v (IV ' 10 ; D> 

where q g is an upper limit on q^, occurring at a value of - e , 
e > 0* The limiting values of e and q g would be determined by the type 

of computational hardware employed* 

Since the zeroes of (11-16 *B) depend on the ratios 



q. 

— ' ^ j ® 1, 2, *.*j (n-1) 


then if q varies the q, must be altered also to keep the zeroes (due 
nan Jn 

to the Q ratios) fixed* From (IV-2*D), the polynomial expansion is 


*nn 


s „-l + s"-2 + ... + 


nn 




(IV-ll.D) 
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Defining the ratios as 



j = 1, 2, ... (n-1) 


which are a priori chosen* then the necessary adjustment rule for the 

q . , would be 
ij 

q^ n = a jq nn j = 1» 2, ... (n~l) (IV-12.D) 


The original Lyapunov theory on which the adaptive control theory 
discussed is based assumes Q is constant, so to insure this a sampled 
data adjustment law employing a zero-order hold for (IV-l.D) and (IV-10.D) 
is proposed. In this way, at any given instant the system will "see" 
only constant terms for the Q elements. The adjustment rules then 
become 


%<“> -S r nl 

1=1 

q nn^ kT ^ ~ K^OcT) 


l 

x im (kT) + £ (»)U (kT) 

j 3 

sat(q s ) 


(IV-13.D) 


(IV-14.D) 


where 


k = 1, 2, ... sample instants 

T = sample period, i- 

k^ - desired root locus gain value 

- saturation value for q 
M s ^nn 




Figure IV-2.D. Adaptation Process Using Dynamic Error Adjustment Technique. 


138 





139 


The question of transient response difficulties and the possible 
instability of the adapted system with the sampled-data adjustment law 
arises. The Lyapunov theory used guarantees that as t + ®, e + 0, one 

of the requirements being that Q be constant. If so, then ||e(t)|| will 

■ 

continuously decrease after starting at some peak value since V(e,t) < 0. 
This is illustrated in Figure IV-3.D (a), (b) , (c) wherein different 
values of Q are applied at discrete time points. If adaptation is 
initiated at t = t^ there will be a Q matrix Q = . If at time 

t = t2 > tj a Q adjustment is performed, then 

|je(t 2 -At)|| < ||e(t 2 )|| < |je(t 2 +At)|| (IV-15.D) 

and t 2 merely becomes a starting time for a new adaptive controller 
configuration. The sample rate for the Q adjustment is of no consequence 
as far as stability is concerned, the higher it being the better the 
approximation to time -invariant error dynamics. As an estimate of the 
lower bound for the sample rate one might invoke Shannon's Sample Theorem. 

A continuous adjustment law using (IV-9.D) and (IV-10.D) cannot 
be employed and asymptotic stability be assured because by using the 
adaptive laws in [5, 6, 7], the resulting V terms are sign indefinite. 

It could be that such a continuous adjustment law would be stable, since 
Lyapunov’s theory provides only sufficient conditions, it is just that 
nothing definite can be said. It should be pointed out, however, that 
simulation results have revealed that the continuous adjustment law 
works well in practice. 

Since the Q elements are adjusted, it is necessary to insure that 
the p.d. Q and n.d. A m Q + QA^^ conditions are met. Since all Q elements 




Figure IV-3.D. Error Reduction Using Lyapunov Adjustment Technique (a), 
(b) Timing and Error Reduction, (c) Typical Error 
Trajectory Illustrations. 
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are adjusted in the same proportion, if at t = 


t 0 ’ q nn q nn. 


Qltr 


nn 


o o 

q ll q 12 • 

„■ 0 
• • q ln 

o o 

o 

q 21 q 22 * 

* » 

* * 

' ' q 2n 

m 

• 

• ♦ 
o o 

• 

0 

q nl *^2 

Sin 

= q^, then 


Ql t c 

> 0 


A m Q lti + Q lt 1 A m " C [^Ito + ^ItcAn 

the p.d. and n.d. conditions are not changed by the adjustment technique 
(they are relatively changed, however). 

For the case of step inputs of different values at different times, 
the necessary adjustment scheme is particularly simplified, as then 


is in the form 


o2 


l 


K h - r nl V Yi 


(IV-16.D) 


but since 


x i° * E G (°> u 


(IV -17 .D) 


then the necessary adjustment equation for q^ can be written as 


desired 


’nn 


r n! 6Co)U? ) + £ fjUj* 


(IV-18.D) 
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a particularly simple form to implement. 
Example 1: 


u~ = G m (s) ■ ~J 


s" + 2s + 2 


G^(s) - — ^ 


s + 2s + a 2 ^ 


Using the adaptive law in [6], an a priori determined acceptable error 
characteristic equation is 


t | 10(s + 2) 2 

s(s 2 + 2s + 2) 


= 0 


(IV-19.D) 


The root locus of (1V-19.D) is shown in Figure IV-4.D. Since x,° = 

1 m 

G m (o)U °’ selecting a n - 10, & 21 - 5, q 12 = 2q 22 then 

2 2 
k = 5q 22 U 0 and q 22 = -L 

U o 

To account for U° = 0, a saturation value of q £2 - = 1000 was used* 

The resulting q nn versus characteristic is shown in Figure IV- 5* D. 

Shown in Figure IV-6-D is the result of using the adjustment scheme 
in (IV-18.D) for the cases U = . 06y(t), U = 5p(t), U = 3y(t). These 
results are compared with those obtained without the adjustment rule in 
(a), (b) , (c) and the three input adjustment cases are compared with the 
desired response (based on the magnitude estimation technique) . Note 
the excellent correllation between the adjustment results and the standard. 
A time-varying example using (IV-13.D) and (IV-14.D) was also run. 


using 



Figure IV-4.D. Root Locus Plot 


1 + 


K q 22 (s + q 12 /q 2 2 )(s + K l /K 2 5 


= 0 


s(s z + 2s + 2) 


q 12 /q 22 “ 2 


K x /K 2 = 2 


v 0 2 
K 2 = 8 21 = S 21 U q 


For k - q^K 0 - IQ , the closed loop error roots are 





U = sin 3t 


The results for various sample periods T are shown in Figure IV-7.D, 
where the initial error, e^ = .1 The particular adjustment process 
used employs state measurements Xp^(t) instead of U^(t) for the sampled- 


data update. Note that, even with need for q (since — 

s x r 


08 at a 


finite number of points), the time-varying adjustment process results 
In an error response similar to that predicted by the time-invariant 
linearization process. 

One point to note, however, is that unless that sample period rate 
T is short enough , the error response will tend to exhibit characteristics 


of the forcing functions Uj(t), i.e. e(t) may exhibit a decaying sinusoidal 
characteristic if the inputs are sinusoidal. 




Results From Adjustment Scheme 
p Input s . 
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KEY 


Unadjusted ~ 4q 22 “ 2 



Figure IV-7*D- Error Response Using Adjustment Scheme With Sinusoidal 
Input ♦ 



V. RELATED TOPICS 


The earlier chapters of this report have related various topics 
concerning the design of model-reference adaptive systems. Theoretical 
results for implementation difficulties such as stability hounds and 
noise error bounds have been presented. In this chapter, some simulation 
and numerical results for practical implementation difficulties where 
no exact mathematical results are presently available will be presented* 
These results give a qualitative indication of what the designer could 
expect an MRAS control system to look and operate like under real-world 
conditions. 

A. Simulation Results For A Physically Realizable Space Shuttle Pitch- 
Axis Controller 

An example was given in Chapter II relating the developed design 
theory of MRAS control to a hypothetical pitch axis controller. Neglected 
at that time was the problem of physical implementation* A simulation 
example will now be given where in practice the theory of adaptive 
control does not exactly fit the problem and hence exact analytical 
results regarding stability of such cases has as yet not been developed. 
However, from a practical approach, as long as the differences between 
theory and practice are not great, experience dictates that results 
should be expected to be similar. 
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In Figure V-l.A is shown a typical Shuttle-type aerodynamic control 

model-reference configuration. This contrasts with Figure II-4.D which 

disregards physical limitations. Note that in Figure V-l.A the summing 

junction is inside the dotted line which means that it is a mathematical 

junction and not a physical entity. The gains from the on-board computer 

are instead fed through an electrical junction I2 where an error drive 

signal is developed to power a servo actuator to move the aerodynamic 

control surfaces. The resulting physical placement of the surfaces then 

causes forces and moments on the vehicle, and this is shown by a passing 

through b D and 5 through b D . The crucial differences of Figure V-l.A 
h 2 e f 2 

from II-4.D are that 

(1) time varying, unknown input gains b and b are not 

adapted as in Figure II-4.D 1 2 

3 3l 

(2) the feedback adaptive gains and are fed back 

through b D and b_ 

P 1 p 2 

(3) an external mechanical servo is used to convert electrical 
drive signals to mechanical control 

These differences alter the theory in the following manner. The 

basic attitude controller of Figure 11-4. D has a transfer function of 

the form 



< k 21 + b Pl > 

s 2 -(K * + a,S)s -(K * + a,?) 


(V-l.A) 


where b D , a D , a D are unknown, time-varying parameters. The basic 
F 1 v 2 f 1 

adaptive control theory outlined in Chapter II relates to (V-l.A), where 
the adaptive gains are strictly additive with respect to corresponding 




Figure V-l.A. Practical Implementation of a Shuttle-type Attitude 
Controller During Re-Entry Phase* 
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plant parameters. The equivelant transfer function from Figure V-l.A is 


(K 2 jK f b p ^ + a 2 ^)s -(K 2 l K f b p i + a 21> 


(V-2.A) 


where 


K - servo gain (dynamics neglected for illustrative purposes 
only) 

In (V-2.A) the adaptive gains are effectively multiplied by b_ K f , an 

P 1 

unknown quantity. This creates two problems 

3 - 3 

(1) The effects of K 2 1» K 22 must reach E. with an effective 
positive sign connected with them and if K f b p is negative, 
then an appropriate sign change is called format 

Failure to do this will lead to instability of the MRAS 
controller. This implies that only some gross knowledge of 
the sign of K^b need be known. 

f Pi 

(2) K f b Pl bas effect of "altering" the adaptive gains 
which were computed according to a theory which did not 
account for these terms. In effect this means ..that in .. 
the implementation problem, adaptive gains K 2 J and K 22 
should be used as feedback gains , 


a 

'21 

t U 

t— I 

u 

II 


a 

22 

= K 3 
22 / K 


(V-3.A) 


a a 
K . K„„ 


K 2 1 > represent adaptive gains computed according to 
(11-18. A) and (11-19. A) 
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a a 

, K,^ - actual electrical feedback adaptive gain signals 

K - best estimate of K^bp with both magnitude and sign taken 
into account *1 


Another problem related to physical realizability is that of incom- 
plete adaptation of even the gains. Due to costs and hardware com- 
plexity it may not be possible or desirable to construct all gains. In 

a 

terms of the simple example in Figure V-l.A this would suggest that 
might not he adapted. 

In Figure V-2.A are shown simulation results for the control system 
of Figure V-l.A for the cases of incomplete adaptation and time-varying 
feedforward gains (i.e, hp^Kf of Figure V-l.A). The simulation conditions 
are listed in Table V-l. The parameters a,B ,y ,5 are as defined in 
Section D of Chapter II. 


G m _(s) = -E( S ) = — 


(s+l )(s+2) 


Gm 2 (s) ^s) ^ 

attitude ( s+1 )( s+2 ) 


< 1]_2 — 3 * ^22 — 

^initial = secon(is (see Figure II-3.D) 
a 21 = ®21 = 4 ^ 00 ., = 400 ., = 100 . 

a 22 4 000 . , $22 = 1000 » , “^22 ~ ^ G 0 . , ^22 ~ 100 » 

e l = e m- e p e 2 = ®m-®p 

a = 60° , attitude = 65° 


Table V-l. Simulation Data for Results Shown in Figure V-2.A. 
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Figure V-2.A # Simulation Results for Incomplete Adaptation 
and Time -Varying Forward Gain 
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Note that, although exact theory is not available yet to describe 

the error dynamics for the adaptive controller subject to time-varying 

unadapted terms such as bp_^ , bp^ of Figure V-l.A and incomplete adaptation 

(i.e. = o in Figure V-l.A), the simulations reveal results similar 

to those expected from exact theory. With time varying b^ the errors 

L 1 

were larger than from the exact methods , but the overall response was 
very similar. For the case of incomplete adaptation errors were larger 
than expected and there was a slight overshoot not predicted by the 
theory, but the overall "shape" of the response was as would be expected 
based on the linearization design of Chapter II. 

This example illustrates that, from a practical standpoint, the 
Lyapunov MRAS adaptive system has merit even when many of the mathema- 
tical idealizations are not met in practice. Of course, simulation 
results can only provide a qualitative guide to stability, but indica- 
tions are that practical implementation need not limit the adaptive 
control approach. 


B. RCJ to MRAS Attitude Phase-Over Control During Re-Entry. 

During the orbital flight phase , the Space Shuttle attitude is to 
be controlled by some form of reaction control jets. Such a control 
system allows a trade-off between attitude error (on the order of 2° -3° 
usually) and low fuel consumption [23]. The control system for the RCJ 
package was designed assuming no aerodynamic forces would be present a 
very reasonable assumption at altitudes of 500 thousand feet or more. 
However, during re-entry aerodynamic forces begin to build up on the 
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vehicle, which, coupled with severe re-entry corridor attitude limits 
and unknown time-varying plant parameters, suggests that an MRAS controller 
might be used during the re-entry phase. 

Unlike the Apollo and Gemini craft, the Shuttle has large wings for 
lift and it is exactly this lift capability which tends to nullify the 
stabilizing RCJ control torques during re-entry. This is because the 
moments due to aerodynamics very quickly become orders-of-magnitude 
greater than those available from conventional RCJ systems. 

To facilitate the two different control modes, some sort of switch- 
over routine is needed. Some of the obvious alternative techniques for 
determining when to switch from RCJ to MRAS control during the re-entry 
profile include 

(1) perform a switchover from total RCJ to total MRAS 
control according to a fixed criterion (probably 
based on Monte Carlo-type simulation data), i.e. 
altitude, Mach number, dynamic pressure, attitude- 
hold capability 

(2) on-line manual pilot switch-over according to his 
"feel" of the controls 

(3) employ an automatic on-line technique for propor- 
tioning the control between RCJ and MRAS 

It is ( 3 ) above which is of interest here. 

The RCJ controller is of the form shown in Figure V-l.B, where only 
the pitch axis is shown, it being assumed decoupled from the roll-yow 
axes. The coefficients A^ and are time-varying coefficients due to 
aerodynamic parameters, T is the thruster force, Iy the vehicle pitch- 
axis inertia. In deep space the A^, A^ are zero, but during re-entry 
these terms change to non-zero values. The actual values are unknown 




Figure V-l.B. RCJ Pitch Control System. 
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because of the indeterminate nature of the particular re-entry profile. 
With such a bang-bang controller, a reasonable trade-off between attitude 
deviation and fuel consumption is obtained. During re-entry, the aero- 
dynamic coefficients alter the RCJ controller effectiveness and the need 
for aerodynamic control increases . 

A basic adaptive attitude controller for the pitch axis is shown 
in Figure II-4.D. Given sufficient aerodynamic lift such a system can 
stabilize a re-entering Shuttle-type vehicle regardless of the actual 
plant parameters. As was illustrated by an example in Chapter II, the 
plant of the re-entering Shuttle can be unstable (without compensation), 
and without some form of adaptive control the vehicle could burn up. 

Shown in Figure V-2.B is one possible physical implementation of a 
'total' attitude control system. The heart of the system is the "con- 
troller proportioning device" which determines, on-line, which type of 
control, either RCJ or MRAS should be used at any given time. 

Defining control effectiveness to be the amount of influence exerted 
on a space vehicle by a particular control system, the basic problem 
during re-entry is to optimize this "effectiveness" such that minimum 
attitude deviations occur. The control torque due to RCJ control is 

T RCJ = (L/2) * F (V-l.B) 

where 

^RCJ = t°rque due to system 

L/2 = effective moment arm for a single axis thruster 

F = net thruster force 




Figure V-2.B 


Pitch Axis Control For RCJ to MRAS Phase-Ova? 
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and the torque due to aerodynamic surfaces as 


T MRAS “ 5 e) 


(V-2.B) 


+ J<pVS c C a 
ref 


I'mRAS = torque due to MRAS control 

c = reference length 

S re £ = wing effective reference area 
2 

%dV = dynamic pressure 

C m = wing pitching moment derivative due to z. 

A proportioning signal y representing the fraction of MRAS control as 
compared to KCJ is to be determined. 


o < y < 1 


It is hypothesized that this phase-over control be a function of an on- 
line measurable parameter indicative of aerodynamic forces, so it is 
assumed that 

y = f(!*pV 2 ) (V-3.B) 

2 

since the dynamic pressure (^pV ) is related to aerodynamic control and 

is available. As a simple approach, y is assumed of the fora of a 

2 

polynomial in (%>V ) , 

2 n 

y = a Q + a^_x + a 2 x \ , . . + a^x (V-lt.B) 


where 
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x = 

a Q » a^ 3 ag> . . * a n 8X6 coefficients to be determined 

This form of control is hypothesized because, in addition to being a 
function of an on-line measurable parameter, it is simple to implement, 
requires little computation time, and is a continuous function (so there 
will be no discontinuity in control). The amount of RCJ or MRAS control 
is then determined by the fraction of EDRIV1 , and EDRIV2 shown in Figure 
V-2.B, available as a control signal 


amount RCJ control = (l-y) (EDRIVl) 
amount MRAS control = y • (EDRIV2) 


(V-5.B) 


The degree of the polynomial, n, is assumed to be at least of order two 
(to be explained later), but may be of any size, depending on the number 
of data points used. 

There are at least three well-defined control points for a re-entering 
Shuttle-type vehicle (at least for the purposes of this presentation), 
and these three plus any additional points based some a priori selected 
criteria, may be used to determine the coefficients a^. These three 
control points are 


(1 ) deep space-full RCJ control 

(2) atmospheric flight at - 150,000 feet-full 
MRAS control 

(3) the point in time at which T _ = t mras “ 
control is assumed 50 $ each mode 
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Other additional points could be defined on the basis of a given pro- 
portion of MRAS control for a given aerodynamic pressure. The control 
points then define a phase-over profile as a function of the dynamic 
pressure. 

The simplest case is for n = 2, when 

y * a Q + a^x + a 2 X (V-6.B) 

2 

Using this approach a parabblic function of the form y = x is obtained. 
Ideally y should be a single-valued function of x, and the simplest form 
is then 

y = agx 2 (V-7.B) 

To further define the three control points, the following assumptions 
have been made : 

(a) x . is assumed to he zero 

mm 

(b) if x<x min » * “ 0 

(c) Cju^ is constant during re-entry phase-over (this 
is approximately correct for the large (>5) Mach 
numbers and large (= 60 °) angle-of-attack encountered 
during re-entry) 

In order to insure that only positive numbers are used for y, the y 
obtained from (V-U.B) is passed through a saturation device so that the 
actual y used as a controller signal is scaled to lie between 0 and 1. 

This is shown in Figure V-3.B. 
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Saturation Device, 



Figure V-3.B. Circuit to Insure That the Phase-Over 
Control y Lies Between 0 and 1. 

Using (V-7.B) the three control points reduce to a 50$ phase-over 
point and a 0 % phase-over point, where the 50$ point is defined as 

5 (V-8.B) 

T T 

RCJ + MRAS 

Equating the two torques and solving for p, the dynamic pressure 
can be obtained. This defines control point 2. Using (V-T.B) a 
particularly simple relation for point 3 is obtained. Using 

y = agx 2 

y 2 = .5 6 x = x 2 

y_= l. @ x « = 2 x 2 

So if x^ is determined (using (V-8.B)), then x^ is fixed. Computation 
of control phase-over is greatly simplified then, requiring only (V-8.B) 
and (V-T.B) An example will now be given to illustrate how this y 
function is computed for the simplest case, n = 2. 
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Example : 


x 50% 


x = Jgpv > 0 

Compatable Space Shuttle data 
L/2 = 50 ft. 

F = 250 lb. 


c = 200 ft. 

s ref = 10,1 


KJ- IV 


= . 002/degree 


^nominal’ = ^ 


a = 60° 

h 

V - 1.0T x 10 ft. /sec 


is found by equaling (V-l.B) and (V-2.B) and solving for p 


P = 


(k 2 ) F 


(V-13.B) 


c > 5 c|C m |o + V|c | |6 
a 111 o e 


(50) (250) 


ii 14, 

Js(l. 07x10 )(10 ) (200) 


k( 200 ) ( 2xl0 -3 ) ( 60 )+ ( 1 . 07x10** ) ( 2x1 0 -2 ) ( 1 ) 


—8 3 

- 5-l6 x 10 slug/ ft. 


*50% ~ ~ * 2 9 lt./ft. 2 y = a g x 2 


•5 = a 2 (. 29 ) 2 
&2 = 5-95 


from which 
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Additional data points could be added by specifying y at a particular 
(estimated) aerodynamic force level, or some of the previously suggested 
control points could be redefined. The n = 2 case is attractive, however, 
as there are not local optima to contend with. 

A simulation of the control system shown in Figure V-2.B was run 
with the control phaseover scheme discussed in the example and the results 
presented in Figure V-ij.B. and V-5.B. 

C. On-Board Control Computer Computational Requirements 

Whenever one speaks of applying modern control theory to a practical 
problem, the age old questions of physical realizability and practical 
implementation arise. In the case of adaptive control, the concern 
generally rests with the complexity of the controller and the difficulty 
of real-time operation with limited computational hardware. In this 
section the computational requirements for implementing a model-reference 
system are discussed and some numerical results for a specific example 
presented to illustrate computation time as a function of the system 
order and the number of inputs processed. 

The basic plant dynamics considered were of the form 



’ 0 

1 

0 .. 

. 0 


0 

0 ... 

0 - 


0 

0 

1 .. 

. 0 


0 

0 ... 

0 


-4 

p 

“°1 

p 

-ag 

-a P , 
n-1 

x + 
_P 

b_ 

n l 

s 

V 


U 


(V-l.C) 



10 radians 
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where the terms are as defined previously. It is assumed that all terms 
are adapting so that ’’worst case” estimates will he available. The basic 
integration routine considered was the fourth-order Runge-Kutta and the 
differentiation process (used only with the Boland and Sutherlin method) 
was a basic 2nd order Lagrangion interpolation polynomial. Computational 
requirements were determined as a function of n{system order) , r (number 
of inputs), plus computer add, subtract and multiply times. 

The equations considered were 

(II-18. A) n of these 

(11-19. A) r of these 

(II-2.A) n of these 

(II-1.A) n of these 

(II-5.A) n of these 


Using these and the numerical analysis methods mentioned, equations 
relating add, subtract and multiply times in terms of n and r were 
determined for the cases of [5,6,7]. The results are tabulated in Table 
V-2. 



Table V-2. Computation Cycle-Time Equations 
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Using data for a particular class of aerospace computers [2i+], 
computer time requirements were determined using the data in Table V-2. 
and are presented as a series of graphs showing computation time per 
cycle versus system order with the number of inputs as a parameter* 

Figure V-l.C shows the computation time* in order to perform a 
single set of computations for the adaptive gains at a given instant » for 
the Boland and Sutherlin adaptation technique. This method [ 7 ] repre- 
sents the greatest computational load of the three methods discussed, 
but as shown in Figure V-2.C, this upper bound on the time is about equal 
to that for both [5] and [6], The small differences between computation 
times for the various methods shown in Figure V-2.C means that computation 
time need not enter the consideration as to which technique to employ. 
Instead, such factors as the number of terms to adapt and model order 
might be of greater importance* 

It should be pointed out that the cycle times listed are based upon 
a digital implementation of continuous systems equations. In actual 
practice, most likely a discrete-data set of equations would be imple- 
mented. In this way only summers, multipliers and delays would be needed 
to implement the adaptive equations. Most likely the indicated computa- 
tional cycle time would be much smaller for a discrete-data implementation. 

The reason an estimate of the discrete-data implementation was not 
given was that the adaptive control theory used in this report is based 
on continuous systems and thus far, very little concerning exact results 
for the discrete case is available. This is an area which has further 


research possibilities. 
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Figure V-l.C. Computation Time/Cycle for the Boland & Sutherlin MRAS Implementation. 
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The previous results given are for the case when the on— board 
computer is all digital. In the case of present spacecraft controls, a 
hybrid or all analog approach is sometimes used, due to high reliability 
and simplicity. Figure V-3.C is an example of the actual adaptive equation 
implementation for an all-analog system, illustrating the difference 
between available measurements and actual required computations and 
adjustment controls. 

D. Use of More Than One Model During Re-Entry 

Because of various types of inputs and environment that a plant 
might be subjected to, it might be desirable to utilize different models 
for different plant operating conditions. The adaptive control theory 
discussed is based on time-invariant models, so some sort of switching 
routine would be required to change the plant response. During the 
transient phase when switching models, the error analysis techniques in 
Chapter II can be utilized (assuming constant inputs) to describe error 
transient response. This is because the analysis theory is based on the 
supposition of a jump change in a plant parameter. If , at t = t” 


G ( s ) 
m 
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n m n-1 m n-2 m 

s + a^ . s + a„ Q s + . . . a_ 
n— l n — d o 
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where 

* f <h> - 

+ p P / + \ P / ~\ 

and at t = t 1 the jumped to values a^ (t^) = a^ (t^). 

Under such circumstances the new model at t = t* would be used as A (s) 

in (II-16.B). This shows then, that a step change in a model value has 

the same effect as a step change in a plant parameter. To the plant 

system the unchanged plant parameters appear as step changes with 

respect to the new model parameter values. 



VI. SUMMARY AND CONCLUSIONS 


A . Summary 

A large number of generally related topics of stability, analysis, 
design, and implementation of a class of MRAS controllers were presented. 
In order to employ these techniques in one grand design package, the 
following design synopsis is presented. 

With a plant and model in the form 

. 

x_ = Ax + Bu 

A A 

where A, B are given by (II-15-B) a basic error characteristic equation, 
given in (II-16.B) was derived for the adaptive gains given in (II-18.A) 
and (11-19. A) for the system defined in (II-1.A), (II-2.A), (II-3.A), 
(II-U.A), and (II-5.A). Using these, and given a knowledge of the q. . 
ratios, the fixed adaptive gain parameters a, 6, p, y, 6, a may be 

~ A 

selected. In case B terms as well as A terms of the plant are adapted, 
(II-11.C) should be employed. To estimate the maximum error e^ and the 
time increment which passes after a plant disturbance before this 
maximum occurs, (II-5.E), (II-6.E), (II-12.E), (II- 15 .E), and (II- 16 .E) 
are employed. 

To determine "zero" placements of sn+< l( n _i) n /q Tin s n ' 1 +. . .+q^ /q^ 
the technique outlined in section III.C may be used, along with the 
computer program QRANGE . Exact analytical results for a 2 order 
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system were given for (III-2.E) in (III-6.E). An extended stability 
bounding criteria, subject to the restrictions given in section III.B 
is given in (III-6.B). Although restrictive in when it may be applied, 
such a technique does allow the designer more freedom in the transient 
error selection. 

The effects of stochastic noise on both inputs and states simplify 
to the need to minimize (IV-10.A). Error sensitivity under noise 
reduces to an evaluation of (IV-T.B) and (IV-8.B). 

In section XV. D an adjustment technique to insure time invariant 
error dynamics was presented. The major results are presented in 
(IV-10.D), (IV-12.D), (IV-13.D), (iV-lfc.D), and (IV-18.D). 

Using the equations outlined in this section, a control engineer 
with only a background in classical control design could easily design 
an adaptive controller. 

B. Conclusions 

1. The non-linear time-varying adaptive gains can be analyzed in 
a linear fashion such that only classical control knowledge is required. 

2. The basic design and analysis of MRAS controllers can be 
reduced to a series of simple computer programs suitable for interactive 
terminal use, relegating drudgery work to computer aided design (CAD) 
studies and allowing for maximum flexibility and design by the design 
engineer. 

3. Analysis of stochastic noise effects can be easily handled 
and an upper bound on the error norm obtained. 
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4. Analytical results from Chapter IV and simulation results from 
Chapter V indicate that even when many of the necessary conditions (i.e. 
model and plant of the same order, all states adapting, etc.) are not 
met in practice, overall response characteristics and the resulting plant 
stability are at worst only slightly affected, suggesting that adaptation 
offers a viable solution to unknown (and possibly time -varying) plant 
control , 

5* Very little applied research has been performed in regard to 
practical implementation difficulties and there is much room for ad- 
ditional study in these areas. 

Some of the possible areas for additional study include the use of 
state estimation for reconstructing missing plant states, CAD of the 
design phase, decoupling of multi -variable adaptive systems, and effects 
of various classes of nonlinearities (especially saturation) on 
Lyapunov stability constraints. 
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APPENDIX A 


Derivation of Defining Equation for Determining 
Bounds on the Elements 


Using (III-2.C), repeated below, a matrix equation will be 
developed for determining bounds on the q^j elements. 


V Q + QAm 


2c u Q 

- 2C 22 * 

. 0 - 


0 


(III-2.C) 


2 c, 


nn 


The c i:L entries are all greater than zero and can take on values in the 

range of 0 + to 00 . The case where the q^'s are not necessarily equal 

( 

will now be used to obtain generalized ratios of Qij/q^ and these 
ratios compared with those values obtained from a Routh-Hurwity array. 
With Aju in the phase variable form (I1I-2.C) is computed as 
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Expanding, (A-l) simplifies to (A-2) shown on the following page. 
The left hand side forms a symmetric matrix, so when equating the 
matrices term by term there are only n(n+l)/2 linearly independent 
equations. Using the fact that 

A * T Q + Q A m = Ib ij J 

where = b ji 

the equations are 

~2q a “ = -2c. . 

H ln nl 11 

m m n 

q ll _q ln a n2 q 2n a nl " 0 

q 12' q ln a n3 “ q 3n a nl = 0 

q 13 _q ln a n4 m “ ^n^l" 1 = 0 

q lCn-l)“ q ln ani1 " q nn a nl 




(A-l) 


(A-3) 
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2 q 12 " q 2n a n2 m 2c 2 


q 22 + q l3 " q 2n a n3 " q 3n 


XU /k 

a „ =0 


q 23 + q 14 - q 2n a n4 1 " " q 4n a n2 1D " ° )> n-1 termS 


q 2(n-l) + q ln q 2n a nn q nn a n2 ® . 
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Defining n(n+l)/2 “ m, (A-3) can be placed in the form 


Ax = b 


A - mxm constant matrix 


— " [ q H q 12 *'• q ln q 22 q 23 * *’ q 2n q 33 


lxra vector 


- lxm vector made up of 0’s and (-c^) terms 
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q ll q i2 q i3 q 22 q 23 q 24 * ‘ * 0 q nn 

b = ” c i -i 0 0 • • • 0 0 ... 0 ... -c (A-6) 

For the general case, the entries in the A and b matrices of (A-4) are 
very detailed, hence an explanation is in order. 


A may be partitioned into n sub-matrices , the sub matrices de- 
creasing in size from nxm to lxm in steps one 1, 
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These sub-matrices may be generated according to 4 basic rules. To 

simplify the explanations, elemental locations will be referred to in 
terms of the row number of the kth sub matrix and the column location 
by the location of the q th element, i.e. 


q ll q 12 q 13 *•* q ln '** q 2n q 3n q nn 

A* 1 * 

A«> 


A<“) 


The q. .th element in x can be determined from 
ij — “ 


x, . = q 
(p) ij 


i-2 

, p=(j-i + l)+J (n-A) 

A=0 


where -1 

£ (n-A) = 0 by definition 

1=0 


,(k) 


The four rules for construction of the A K ' are: 

(1) diagonal of l's starting in row 2 of q^, k = 2,3,* * *n 

(2) diagonal of l's starting in k = 1,2, * * *n 

where qQ^ is disregarded 

C3) in column, sequence of -a^ 10 j = k, k + l,***n 


nj 

m 


(4) "diagonal like" array of -a , from entry to q 
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entry. 
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As an example of this technique, for the fourth order plant- 
model system, where 
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the resulting "A” matrix of Ax = b_ is given on the following page. 
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APPENDIX B 


Phase Variable Transformation 


The derivation of the perturbed error characteristic equation 
given in (11-16. B) requires that the plant and model state matrices 
be in the phase variable canconical form 


where 


A = 
m 
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'So 


1 
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(B-l) 


s " + + ^ Cn -”) 3 ”' 2 + -• + \ 0 ‘° <B - 2) 


represents the characteristic equation of the model* The conditions 
under which a transformation exists which will result in a coordinate 
transformation from one state space into another is given in this 
Appendix* along with the transformation. 

Consider the time-invariant n ^ order model 


z = Kz + Du 


(B-3) 
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where 

u is r x 1 input vector 

K is n x n matrix not in the form of (B-l) 
D is n x r matrix 
z - n x 1 state vector 
D can be written in the form 



(B-4) 


where the d^ i = 1,2/ “r are the column vectors of D. It is 
desired to determine the transformation matrix T, such that 


z ® Tx (B-5) 

and the conditions under which T exists. A necessary and sufficient 
condition for (B-3) to be transformed to the form 


x = Ax + B u 


(B-6) 


where A is in the form of (B-l), is that the system be controllable. 
This is true if at least one of the matrices has rank n, 
where r— — , 


Q 


i 



K (n-1) 



(B-7) 


and is the controllability matrix of the system in (B-3). If one 
of the has rank n, then a transformation matrix T will exist such 
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that 

z - Tx 

and T will transform a system in the form of (B-3) into the form of 
(B-6) , where the matrices K, A and D, B are related by 

A = T -1 KT B =■ T _1 D (B-8) 


The B matrix is of the form 


B = 


b ll b 12 **' b lr 

b 21 b 22 *** b 2r 


b nl b n2 * * * b nr 


b/% » • « b 
2 r 


(B-9) 


where in general at least one of the column vectors b i is of the form 


b i = 


l°\ 




i - 1,2 , * * ‘ r 


(B-10) 


A straightforward technique for confuting T is given in J20J . 

If (B-3) is such that K is in the form of (B-l) , then no trans- 
formation is required. In this case, D (or B) may consist of any 
combination of n x r terms. In general, when the plant model dynamics 
are such that the system matrix is in phase- variable form, then the 
system flow model will appear as in Figure (B-l) . 




Figure (B-l) Flow Diagram of a phase-variable canonical form. 
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In order to possess physical meaning, the artificial states x 
must have a one-to-one relationship with those of the original state 
space. Assuming that one particular state of the original system is 
the major "output” (e.g. , an aerospace vehicle attitude, the flow rate 
of a chemical in a refinery, etc.) and 



(B-ll) 


_t 


nr 



is such that 


t = (1 0 0 *•* 0) (B-12) 

lr 

then there will be a one-to-one correspondence between the actual state 
z^ and the artificial state x^. In a more practical sense, if the 
"0" elements of (B-10) were very small (with respect to 1) non-zero 
numbers, the design results losing the error characteristic equation 
with the artificial states should provide reasonable engineering 
results for the actual state z*. Note, however, that there need not 
be any simple relation between z^ and x^ if i _> 2. 

A positive aspect of using the configuration given in (B-l) and 
(B-9) is that a well defined transformation matrix T can, in general, be 
determined for a multivariable system such that the system matrix is in 
the phase variable Frobenius form. In most application work involving 
multivariable systems, a constraint on the "B" matrix as to the 
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particular form it may possess severely limits the form the "A" matrix 
may take on [21, 22]. The linearization procedure for the error 
equation, however, places no restrictions on the form of the B matrix. 
The resulting transformation is non-unique, as is to be expected with 
multivariable systems, but is straightforward in application. 



APPENDIX C 


Derivation of an Frror Bound with 
State and Input Noises Present 

The noisy plant discussed in Chapter IV is the basis for the 
derivation of the following gross error bound. The model and plant 
equations are 


= A m*m + 


(C-l) 


*p = A o2p + K(t) + B p u(t) 


£ = x - & (t) = e - n(t) 

— — m —p — — 


(C-2) 

(C-3) 


Differentiating (C-3) with respect to time and substituting in (C-2) 
and (C-l), 


Defining 


A = A m x m + B m r(t) - [A^ + K(t)Sp(t) + Bpu(t) + n(t)] 

Ap “ Aq + K(t) 
u(t) = jr(t) + v(t) 

Ap(t) = Xp + n(t) 


(C-4) 

(C-5) 

(C-6) 

(C-7) 


(C-4) can be written as 


£ = Affirm + B ml (t ) ‘ fAp^p + B p2 (t) + V (t) " + H(t)3 

+ \^p ~ A^ (0-8) 
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Combining terms, (C-8) simplifies to 


i = A J- + lA m ‘ A A + t B m - B p^ (t) ‘ V (t) + V (t) - JL<‘> 


6 = Ami + A^p + Br(t) + (-B^(t) + A^nCt) - n(t)) 

^ (C-9) 

(C-9) is the noise-presence equivalent to the noise free case of 

(II- 7. A) , where now the external input is _r(t) instead of u(t) . 

The Lyapunov function for the Boland and Sutherlin [7] method is 

now modified so as to be p.d. in £, u(t) , and it , the available error, 

input and plant states 
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where the notation is analogous to that in Chapter II. The tine 
derivative of V is 


V = 1 T Q£ + && +2 l J aij 
W 1*1 j=l a± J 
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+ *f l Vkl u 

i=l j-l YlJ dt k=l 3 


n r 


+ 2 l l 


6ij aij 


i“l J-l YU 


d y § q u 
dt k.1 kqkl 3 


n r ..... n 2n 

+ 2 l l j I Vki U 1 A J \ q ki U j 

i«l j=l YlJ k=l J dt k=l K J 

+ 2 I l mr l e k^ki u j 77 2 e k^ki u j 

i=l j-l Y*J k=l K1 J dt k=l J 


+ 2 L u ?«- « La^ a 


+ 2 L L pij LA"^ ® l.wn 


+ 2 f . ! . 013 l ,wj If | A\i“j 

1=1 1=1 k=l k=l J 


(C-ll) 


i 

With aij and bij chosen to implement physically realizable controls, 

a±i - -dj | Aq ki *pj - MJ If I AlklSj 

k=l k-1 


n 


-pij — l %q ki 2 . 
dt 2 k-1 k 1 PJ 


(C -12) 
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n n. q j j n, 

v r piJ v 


+ 2 I l l Mki*pj 

i=j j=l J k=l PJ 


+ 2 L U * 13 fe 

+ 2 I I aij l e k q ki ± 

i»l 1=1 3 dt: k=l F ' 


11 14 O J J r - , ** 

+ 2 L k ^ i LA^ 


+ 2 ! i £^7^ i -4 ? «kiki* P j 

i=l j-1 ai J k=l FJ dt 2 k=l K1 p3 


* ’ L s- L' 1 '-"" t L, **'“■■> 


+ 2 |_ x — at ? Wi* P j ^ 5 1 Vki* t 

3 k“l k*=l 


nr,* 


+ 2 I J “J “J ♦ 2 liUiJ e. <L u 

1-1 j-1 i-i j-1 vnr u x “1 


+ 2 z ! $ bi, 4, 1 k k , kl „ 

1=1 j=l Y 3 k=l k:L 3 


+ 2 I I V kl u, 

1-1 j=l Yl3 dt k-1 k kl 3 
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= ^ V ki“j - ^ It ^ =1 a k q ki u j 


-tfiJ ““ 2 6 k<lki u j 
dt 2 k-1 J 


Substituting aij and bij into V results in 


V > i T M, T Q + QVi + 4 T <A» - A p>V + - A p>*p 


+ £ T(B » ■ B p )T « + ^ <B m - V-E - i TB p T< li 

- A T Q B p!L + u\ T Q£ + A T QAoH ■ n T 0i - £ T Qn 


n n 


n n 


I I aij [ Mki*pj " 2 £ I 3 ± j ( £ ^k { lki X pj ) 

i=l j=l k=l PJ i=l j=l k=l K1 FJ 


-2l I bij l ^ki u j * 2 l I «U<! %9kiUi) 2 
i-1 j=l k=l J i=l j=l k=l J 


which reduces to 



(C-14) 

n r n 2 

"2 l l 6ij(J ^q^u.) + 2 £ T Q[A^r- n_ - B v] 

i=l j=l k=l u- m- 


This function, without further information, is of an indefinite form. 
By using a bounding process [ 9 ], (C-14) can be written as 
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n n n 2 

V < + + Q + QA m )e -2 l l 3ij (I Ul,) 

m i=l j=l k=l k k± PJ 


n r n 2 

-2 l l fiij(£ § k q ki u.) + ||Qe||r (C-15) 

1=1 j=l k=l 3 


where F is defined by (IV-7.A) (A T Q + QA ) forms a symmetric 

m m 

matrix, so equating 


then 


If 


then 


K T H = -(A m T Q + QAjjj) 

r | | Oil I =r|tQH' 1 Hi|| <r|jQH" 1 || ||He|| (C-16) 

IlHill > r | | q) I ||h _1 || > rllQH -1 !! (C-17) 

r | I Oil I < r| I QH -1 1 I I I He I J <| I Hi ( I 2 = -i T (A m T Q + QA m )£ 

(C-18) 


and V will consequently be negative definite. 

If A is an n x n matrix and x an n x 1 vector, the norm of Ax 
will be defined to be 

I I Ax|| < M| | x| | ( C— 19) 


where M is the smallest positive number for which (C-19) holds, where 
| | x| | is the Euclidean norm. Using (C-18) 


xVa T Q - QA ) . Mill < | | Hi I I iX^(-A T Q - QA ) | |i| | 

m m min m m max 


(C-20) 
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where \ (A) is an eigenvalue of the matrix A. Defining 


IqII = *(Q) 


max 


- 1 , 


H 


- «V„i„ 


(C-21) 


From (C-19) thru (c-21) , (C-17) can be used to obtain 


> HQ) 


max 


X (“A Q - QA ) 
to w 


r = P 


min 


(C -22) 


This represents an upper bound on the norm of the error vector in 
order to quarantee V is negative definite (n.d.). Very possibly 
j | ej j could be less than indicated by (C-22) and V still be n.d.; it 
is simply that nothing can be said then. Similarly, if for some 
| j §J | < p V became positive definite then the equilibrium state would 
be unstable in the sense of Lyapunov and the plant would be driven 

9 

such that the error increased to the point where V was n*d«. 



